2023-02-09 05:02:38,556 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-09 05:02:38,598 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=188, ProcessCount=168, AvailableMemoryMB=5069 2023-02-09 05:02:38,872 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8 2023-02-09 05:02:38,879 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:02:38,880 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0, deleteOnExit=true 2023-02-09 05:02:38,880 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:02:38,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/test.cache.data in system properties and HBase conf 2023-02-09 05:02:38,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:02:38,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:02:38,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:02:38,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:02:38,882 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:02:38,988 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 05:02:39,413 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:02:39,417 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:02:39,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:02:39,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:02:39,418 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:02:39,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:02:39,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:02:39,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:02:39,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:02:39,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:02:39,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:02:39,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:02:39,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:02:39,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:02:39,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:02:39,988 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:02:39,995 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:02:40,368 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 05:02:40,578 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 05:02:40,595 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:02:40,646 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:02:40,684 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/java.io.tmpdir/Jetty_localhost_38751_hdfs____peoldk/webapp 2023-02-09 05:02:40,835 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38751 2023-02-09 05:02:40,847 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:02:40,847 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:02:41,401 WARN [Listener at localhost/38613] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:02:41,492 WARN [Listener at localhost/38613] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:02:41,516 WARN [Listener at localhost/38613] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:02:41,524 INFO [Listener at localhost/38613] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:02:41,585 INFO [Listener at localhost/38613] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/java.io.tmpdir/Jetty_localhost_36849_datanode____.8l93tr/webapp 2023-02-09 05:02:41,696 INFO [Listener at localhost/38613] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36849 2023-02-09 05:02:42,153 WARN [Listener at localhost/34385] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:02:42,173 WARN [Listener at localhost/34385] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:02:42,176 WARN [Listener at localhost/34385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:02:42,177 INFO [Listener at localhost/34385] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:02:42,184 INFO [Listener at localhost/34385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/java.io.tmpdir/Jetty_localhost_33401_datanode____.aq55ms/webapp 2023-02-09 05:02:42,291 INFO [Listener at localhost/34385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33401 2023-02-09 05:02:42,301 WARN [Listener at localhost/40479] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:02:42,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30e2da93517e270d: Processing first storage report for DS-11773edf-c643-4b44-893c-c20fb70c76d0 from datanode 6f2d5054-2712-4772-9ba2-e771d7b3c710 2023-02-09 05:02:42,686 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30e2da93517e270d: from storage DS-11773edf-c643-4b44-893c-c20fb70c76d0 node DatanodeRegistration(127.0.0.1:42089, datanodeUuid=6f2d5054-2712-4772-9ba2-e771d7b3c710, infoPort=33235, infoSecurePort=0, ipcPort=34385, storageInfo=lv=-57;cid=testClusterID;nsid=699389815;c=1675918960106), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-09 05:02:42,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ab0a97dcf89bc42: Processing first storage report for DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174 from datanode ccf4b9ff-288b-46dc-b421-e21a3ebb9b79 2023-02-09 05:02:42,686 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ab0a97dcf89bc42: from storage DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174 node DatanodeRegistration(127.0.0.1:43335, datanodeUuid=ccf4b9ff-288b-46dc-b421-e21a3ebb9b79, infoPort=35055, infoSecurePort=0, ipcPort=40479, storageInfo=lv=-57;cid=testClusterID;nsid=699389815;c=1675918960106), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:02:42,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x30e2da93517e270d: Processing first storage report for DS-7f13da58-e547-411f-9bf1-f0e882c5f265 from datanode 6f2d5054-2712-4772-9ba2-e771d7b3c710 2023-02-09 05:02:42,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x30e2da93517e270d: from storage DS-7f13da58-e547-411f-9bf1-f0e882c5f265 node DatanodeRegistration(127.0.0.1:42089, datanodeUuid=6f2d5054-2712-4772-9ba2-e771d7b3c710, infoPort=33235, infoSecurePort=0, ipcPort=34385, storageInfo=lv=-57;cid=testClusterID;nsid=699389815;c=1675918960106), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-09 05:02:42,687 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2ab0a97dcf89bc42: Processing first storage report for DS-c701b5fe-48ce-4a48-ac7b-5407962ad22f from datanode ccf4b9ff-288b-46dc-b421-e21a3ebb9b79 2023-02-09 05:02:42,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2ab0a97dcf89bc42: from storage DS-c701b5fe-48ce-4a48-ac7b-5407962ad22f node DatanodeRegistration(127.0.0.1:43335, datanodeUuid=ccf4b9ff-288b-46dc-b421-e21a3ebb9b79, infoPort=35055, infoSecurePort=0, ipcPort=40479, storageInfo=lv=-57;cid=testClusterID;nsid=699389815;c=1675918960106), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:02:42,769 DEBUG [Listener at localhost/40479] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8 2023-02-09 05:02:42,860 INFO [Listener at localhost/40479] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/zookeeper_0, clientPort=63799, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:02:42,879 INFO [Listener at localhost/40479] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63799 2023-02-09 05:02:42,887 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:42,889 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:43,570 INFO [Listener at localhost/40479] util.FSUtils(479): Created version file at hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c with version=8 2023-02-09 05:02:43,571 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:43,572 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:43,576 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/hbase-staging 2023-02-09 05:02:43,921 INFO [Listener at localhost/40479] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 05:02:44,430 INFO [Listener at localhost/40479] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:02:44,464 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:44,464 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:44,465 INFO [Listener at localhost/40479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:02:44,465 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:44,465 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:02:44,609 INFO [Listener at localhost/40479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:02:44,683 DEBUG [Listener at localhost/40479] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 05:02:44,776 INFO [Listener at localhost/40479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46231 2023-02-09 05:02:44,786 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:44,788 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:44,812 INFO [Listener at localhost/40479] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46231 connecting to ZooKeeper ensemble=127.0.0.1:63799 2023-02-09 05:02:44,866 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:462310x0, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:02:44,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:46231-0x1003775da5a0000 connected 2023-02-09 05:02:44,896 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:02:44,897 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:02:44,901 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:02:44,910 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46231 2023-02-09 05:02:44,911 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46231 2023-02-09 05:02:44,912 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46231 2023-02-09 05:02:44,915 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46231 2023-02-09 05:02:44,917 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46231 2023-02-09 05:02:44,925 INFO [Listener at localhost/40479] master.HMaster(439): hbase.rootdir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c, hbase.cluster.distributed=false 2023-02-09 05:02:44,999 INFO [Listener at localhost/40479] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:02:44,999 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,000 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,000 INFO [Listener at localhost/40479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:02:45,000 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,000 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:02:45,005 INFO [Listener at localhost/40479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:02:45,008 INFO [Listener at localhost/40479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34441 2023-02-09 05:02:45,011 INFO [Listener at localhost/40479] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:02:45,018 DEBUG [Listener at localhost/40479] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:45,019 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:45,021 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:45,023 INFO [Listener at localhost/40479] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34441 connecting to ZooKeeper ensemble=127.0.0.1:63799 2023-02-09 05:02:45,029 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:344410x0, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:02:45,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34441-0x1003775da5a0001 connected 2023-02-09 05:02:45,031 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:02:45,032 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:02:45,033 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:02:45,034 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34441 2023-02-09 05:02:45,034 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34441 2023-02-09 05:02:45,034 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34441 2023-02-09 05:02:45,037 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34441 2023-02-09 05:02:45,040 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34441 2023-02-09 05:02:45,052 INFO [Listener at localhost/40479] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:02:45,053 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,053 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,053 INFO [Listener at localhost/40479] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:02:45,054 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:02:45,054 INFO [Listener at localhost/40479] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:02:45,054 INFO [Listener at localhost/40479] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:02:45,055 INFO [Listener at localhost/40479] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40155 2023-02-09 05:02:45,056 INFO [Listener at localhost/40479] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:02:45,058 DEBUG [Listener at localhost/40479] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:45,059 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:45,061 INFO [Listener at localhost/40479] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:45,063 INFO [Listener at localhost/40479] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40155 connecting to ZooKeeper ensemble=127.0.0.1:63799 2023-02-09 05:02:45,071 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:401550x0, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:02:45,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40155-0x1003775da5a0002 connected 2023-02-09 05:02:45,072 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:02:45,073 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:02:45,074 DEBUG [Listener at localhost/40479] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:02:45,076 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40155 2023-02-09 05:02:45,080 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40155 2023-02-09 05:02:45,086 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40155 2023-02-09 05:02:45,087 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40155 2023-02-09 05:02:45,088 DEBUG [Listener at localhost/40479] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40155 2023-02-09 05:02:45,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:45,100 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:02:45,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:45,124 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:02:45,124 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:02:45,124 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:02:45,125 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:45,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:02:45,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46231,1675918963742 from backup master directory 2023-02-09 05:02:45,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:02:45,134 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:45,134 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:02:45,135 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:02:45,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:45,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 05:02:45,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 05:02:45,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/hbase.id with ID: a8079492-80fa-4666-a13d-dc92777e6664 2023-02-09 05:02:45,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:02:45,328 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:45,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5a9a02f3 to 127.0.0.1:63799 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:02:45,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a5afa66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:02:45,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:02:45,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:02:45,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 05:02:45,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 05:02:45,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 05:02:45,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 05:02:45,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:02:45,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store-tmp 2023-02-09 05:02:45,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:45,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:02:45,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:02:45,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:02:45,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:02:45,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:02:45,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:02:45,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918965535Disabling compacts and flushes for region at 1675918965535Disabling writes for close at 1675918965536 (+1 ms)Writing region close event to WAL at 1675918965536Closed at 1675918965536 2023-02-09 05:02:45,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/WALs/jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:45,561 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46231%2C1675918963742, suffix=, logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/WALs/jenkins-hbase4.apache.org,46231,1675918963742, archiveDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/oldWALs, maxLogs=10 2023-02-09 05:02:45,623 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK] 2023-02-09 05:02:45,623 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK] 2023-02-09 05:02:45,631 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 05:02:45,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/WALs/jenkins-hbase4.apache.org,46231,1675918963742/jenkins-hbase4.apache.org%2C46231%2C1675918963742.1675918965574 2023-02-09 05:02:45,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK], DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK]] 2023-02-09 05:02:45,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:02:45,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:45,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,770 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,777 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:02:45,816 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:02:45,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:45,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:02:45,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:45,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61775705, jitterRate=-0.07947026193141937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:02:45,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675918965737Initializing all the Stores at 1675918965740 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918965740Cleaning up temporary data from old regions at 1675918965844 (+104 ms)Cleaning up detritus from prior splits at 1675918965844Region opened successfully at 1675918965860 (+16 ms) 2023-02-09 05:02:45,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:02:45,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:02:45,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:02:45,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:02:45,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 05:02:45,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-09 05:02:45,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:02:45,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:02:45,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:02:45,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:02:45,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:02:45,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:02:46,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:02:46,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:02:46,010 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:46,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:02:46,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:02:46,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:02:46,032 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:02:46,032 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:02:46,033 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:46,032 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:02:46,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,46231,1675918963742, sessionid=0x1003775da5a0000, setting cluster-up flag (Was=false) 2023-02-09 05:02:46,051 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:46,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:02:46,058 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:46,065 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:46,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:02:46,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:46,077 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/.tmp 2023-02-09 05:02:46,094 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(952): ClusterId : a8079492-80fa-4666-a13d-dc92777e6664 2023-02-09 05:02:46,095 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(952): ClusterId : a8079492-80fa-4666-a13d-dc92777e6664 2023-02-09 05:02:46,104 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:02:46,104 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:02:46,113 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:02:46,113 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:02:46,124 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:02:46,124 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:02:46,142 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:02:46,143 DEBUG [RS:0;jenkins-hbase4:34441] zookeeper.ReadOnlyZKClient(139): Connect 0x26088d1e to 127.0.0.1:63799 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:02:46,149 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:02:46,177 DEBUG [RS:1;jenkins-hbase4:40155] zookeeper.ReadOnlyZKClient(139): Connect 0x6afad036 to 127.0.0.1:63799 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:02:46,189 DEBUG [RS:0;jenkins-hbase4:34441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28cf77af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:02:46,190 DEBUG [RS:0;jenkins-hbase4:34441] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cf0e66e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:02:46,193 DEBUG [RS:1;jenkins-hbase4:40155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@643d2319, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:02:46,193 DEBUG [RS:1;jenkins-hbase4:40155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6002bb46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:02:46,215 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40155 2023-02-09 05:02:46,217 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34441 2023-02-09 05:02:46,220 INFO [RS:0;jenkins-hbase4:34441] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:02:46,220 INFO [RS:1;jenkins-hbase4:40155] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:02:46,221 INFO [RS:1;jenkins-hbase4:40155] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:02:46,221 INFO [RS:0;jenkins-hbase4:34441] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:02:46,221 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:02:46,221 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:02:46,224 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46231,1675918963742 with isa=jenkins-hbase4.apache.org/172.31.14.131:34441, startcode=1675918964998 2023-02-09 05:02:46,224 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46231,1675918963742 with isa=jenkins-hbase4.apache.org/172.31.14.131:40155, startcode=1675918965052 2023-02-09 05:02:46,244 DEBUG [RS:1;jenkins-hbase4:40155] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:02:46,244 DEBUG [RS:0;jenkins-hbase4:34441] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:02:46,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:02:46,307 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41619, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:02:46,307 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43159, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:02:46,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:02:46,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:02:46,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:02:46,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:02:46,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:02:46,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:46,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:02:46,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:46,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:02:46,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:02:46,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675918996320 2023-02-09 05:02:46,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:02:46,328 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:02:46,329 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:02:46,335 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:02:46,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:02:46,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:02:46,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:02:46,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:02:46,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:02:46,344 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:46,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:02:46,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:02:46,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:02:46,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:02:46,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:02:46,354 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 05:02:46,354 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(2829): Master is not running yet 2023-02-09 05:02:46,354 WARN [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 05:02:46,354 WARN [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-09 05:02:46,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918966356,5,FailOnTimeoutGroup] 2023-02-09 05:02:46,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918966357,5,FailOnTimeoutGroup] 2023-02-09 05:02:46,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:46,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:02:46,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:46,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:46,378 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:02:46,379 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:02:46,380 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c 2023-02-09 05:02:46,400 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:46,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:02:46,406 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/info 2023-02-09 05:02:46,407 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:02:46,408 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:46,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:02:46,411 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:02:46,411 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:02:46,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:46,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:02:46,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/table 2023-02-09 05:02:46,415 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:02:46,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:46,418 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740 2023-02-09 05:02:46,419 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740 2023-02-09 05:02:46,423 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:02:46,425 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:02:46,429 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:46,431 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72460768, jitterRate=0.07974958419799805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:02:46,431 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675918966401Initializing all the Stores at 1675918966402 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918966402Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918966403 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918966403Cleaning up temporary data from old regions at 1675918966421 (+18 ms)Cleaning up detritus from prior splits at 1675918966421Region opened successfully at 1675918966431 (+10 ms) 2023-02-09 05:02:46,431 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:02:46,431 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:02:46,431 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:02:46,431 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:02:46,431 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:02:46,432 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:02:46,433 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918966431Disabling compacts and flushes for region at 1675918966431Disabling writes for close at 1675918966431Writing region close event to WAL at 1675918966432 (+1 ms)Closed at 1675918966432 2023-02-09 05:02:46,439 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:02:46,439 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:02:46,452 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:02:46,466 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:02:46,469 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:02:46,619 WARN [jenkins-hbase4:46231] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-09 05:02:47,356 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46231,1675918963742 with isa=jenkins-hbase4.apache.org/172.31.14.131:40155, startcode=1675918965052 2023-02-09 05:02:47,356 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,46231,1675918963742 with isa=jenkins-hbase4.apache.org/172.31.14.131:34441, startcode=1675918964998 2023-02-09 05:02:47,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=46231] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,368 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c 2023-02-09 05:02:47,368 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c 2023-02-09 05:02:47,369 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38613 2023-02-09 05:02:47,369 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38613 2023-02-09 05:02:47,369 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:02:47,369 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:02:47,371 DEBUG [jenkins-hbase4:46231] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:02:47,375 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:02:47,381 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:02:47,381 DEBUG [RS:1;jenkins-hbase4:40155] zookeeper.ZKUtil(162): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,381 DEBUG [RS:0;jenkins-hbase4:34441] zookeeper.ZKUtil(162): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,382 WARN [RS:1;jenkins-hbase4:40155] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:02:47,382 INFO [RS:1;jenkins-hbase4:40155] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:02:47,382 WARN [RS:0;jenkins-hbase4:34441] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:02:47,382 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,383 INFO [RS:0;jenkins-hbase4:34441] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:02:47,383 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:02:47,383 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,383 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:02:47,383 DEBUG [jenkins-hbase4:46231] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:02:47,385 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34441,1675918964998] 2023-02-09 05:02:47,386 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40155,1675918965052] 2023-02-09 05:02:47,390 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40155,1675918965052, state=OPENING 2023-02-09 05:02:47,398 DEBUG [RS:1;jenkins-hbase4:40155] zookeeper.ZKUtil(162): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,398 DEBUG [RS:0;jenkins-hbase4:34441] zookeeper.ZKUtil(162): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,399 DEBUG [RS:1;jenkins-hbase4:40155] zookeeper.ZKUtil(162): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,399 DEBUG [RS:0;jenkins-hbase4:34441] zookeeper.ZKUtil(162): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,401 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:02:47,404 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:47,405 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:02:47,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:47,412 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:02:47,412 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:02:47,424 INFO [RS:1;jenkins-hbase4:40155] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:02:47,424 INFO [RS:0;jenkins-hbase4:34441] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:02:47,447 INFO [RS:0;jenkins-hbase4:34441] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:02:47,447 INFO [RS:1;jenkins-hbase4:40155] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:02:47,452 INFO [RS:1;jenkins-hbase4:40155] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:02:47,452 INFO [RS:0;jenkins-hbase4:34441] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:02:47,452 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,452 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,453 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:02:47,453 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:02:47,462 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,462 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,462 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,462 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,463 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:02:47,463 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:02:47,464 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:1;jenkins-hbase4:40155] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,464 DEBUG [RS:0;jenkins-hbase4:34441] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:02:47,465 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,465 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,466 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,466 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,466 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,466 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,481 INFO [RS:0;jenkins-hbase4:34441] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:02:47,481 INFO [RS:1;jenkins-hbase4:40155] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:02:47,484 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34441,1675918964998-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,484 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40155,1675918965052-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,502 INFO [RS:0;jenkins-hbase4:34441] regionserver.Replication(203): jenkins-hbase4.apache.org,34441,1675918964998 started 2023-02-09 05:02:47,503 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34441,1675918964998, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34441, sessionid=0x1003775da5a0001 2023-02-09 05:02:47,503 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:02:47,503 DEBUG [RS:0;jenkins-hbase4:34441] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,503 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34441,1675918964998' 2023-02-09 05:02:47,503 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:47,504 INFO [RS:1;jenkins-hbase4:40155] regionserver.Replication(203): jenkins-hbase4.apache.org,40155,1675918965052 started 2023-02-09 05:02:47,504 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40155,1675918965052, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40155, sessionid=0x1003775da5a0002 2023-02-09 05:02:47,504 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:02:47,504 DEBUG [RS:1;jenkins-hbase4:40155] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,505 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40155,1675918965052' 2023-02-09 05:02:47,505 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:47,505 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:47,506 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:47,506 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:02:47,506 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:02:47,506 DEBUG [RS:0;jenkins-hbase4:34441] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:47,506 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34441,1675918964998' 2023-02-09 05:02:47,506 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:47,507 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:02:47,507 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:02:47,507 DEBUG [RS:0;jenkins-hbase4:34441] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:47,507 DEBUG [RS:1;jenkins-hbase4:40155] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,508 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40155,1675918965052' 2023-02-09 05:02:47,508 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:47,508 DEBUG [RS:0;jenkins-hbase4:34441] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:02:47,508 INFO [RS:0;jenkins-hbase4:34441] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:02:47,508 DEBUG [RS:1;jenkins-hbase4:40155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:47,508 INFO [RS:0;jenkins-hbase4:34441] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:02:47,509 DEBUG [RS:1;jenkins-hbase4:40155] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:02:47,509 INFO [RS:1;jenkins-hbase4:40155] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:02:47,510 INFO [RS:1;jenkins-hbase4:40155] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:02:47,595 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:47,598 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:02:47,601 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:02:47,613 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:02:47,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:02:47,617 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40155%2C1675918965052.meta, suffix=.meta, logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052, archiveDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs, maxLogs=32 2023-02-09 05:02:47,639 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK] 2023-02-09 05:02:47,639 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK] 2023-02-09 05:02:47,644 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052/jenkins-hbase4.apache.org%2C40155%2C1675918965052.meta.1675918967620.meta 2023-02-09 05:02:47,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK], DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK]] 2023-02-09 05:02:47,646 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:02:47,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:02:47,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:02:47,669 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:02:47,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:02:47,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:47,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:02:47,675 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:02:47,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:02:47,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/info 2023-02-09 05:02:47,679 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/info 2023-02-09 05:02:47,680 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:02:47,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:47,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:02:47,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:02:47,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:02:47,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:02:47,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:47,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:02:47,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/table 2023-02-09 05:02:47,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/table 2023-02-09 05:02:47,687 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:02:47,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:47,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740 2023-02-09 05:02:47,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740 2023-02-09 05:02:47,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:02:47,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:02:47,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75203246, jitterRate=0.12061569094657898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:02:47,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675918967675Writing region info on filesystem at 1675918967675Initializing all the Stores at 1675918967677 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918967677Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918967677Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918967677Cleaning up temporary data from old regions at 1675918967694 (+17 ms)Cleaning up detritus from prior splits at 1675918967695 (+1 ms)Running coprocessor post-open hooks at 1675918967700 (+5 ms)Region opened successfully at 1675918967700 2023-02-09 05:02:47,709 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675918967587 2023-02-09 05:02:47,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:02:47,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:02:47,732 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40155,1675918965052, state=OPEN 2023-02-09 05:02:47,736 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:02:47,736 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:02:47,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:02:47,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40155,1675918965052 in 328 msec 2023-02-09 05:02:47,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:02:47,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.2910 sec 2023-02-09 05:02:47,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5520 sec 2023-02-09 05:02:47,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675918965120, completionTime=-1 2023-02-09 05:02:47,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:02:47,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:02:47,825 DEBUG [hconnection-0x6aee7ca0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:02:47,839 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:02:47,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:02:47,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919027856 2023-02-09 05:02:47,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919087856 2023-02-09 05:02:47,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 103 msec 2023-02-09 05:02:47,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1675918963742-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1675918963742-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1675918963742-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46231, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:02:47,891 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:02:47,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:02:47,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:02:47,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:02:47,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:02:47,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:02:47,946 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:47,949 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96 empty. 2023-02-09 05:02:47,949 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:47,950 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:02:47,984 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:02:47,988 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 75d93fd3b4af492fc3e2284a8a89ce96, NAME => 'hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:48,059 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:48,060 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 75d93fd3b4af492fc3e2284a8a89ce96, disabling compactions & flushes 2023-02-09 05:02:48,060 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,060 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,060 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. after waiting 0 ms 2023-02-09 05:02:48,060 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,060 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,061 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 75d93fd3b4af492fc3e2284a8a89ce96: Waiting for close lock at 1675918968060Disabling compacts and flushes for region at 1675918968060Disabling writes for close at 1675918968060Writing region close event to WAL at 1675918968060Closed at 1675918968060 2023-02-09 05:02:48,068 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:02:48,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918968073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918968073"}]},"ts":"1675918968073"} 2023-02-09 05:02:48,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:02:48,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:02:48,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918968124"}]},"ts":"1675918968124"} 2023-02-09 05:02:48,135 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:02:48,141 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:02:48,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:02:48,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:02:48,143 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:02:48,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=75d93fd3b4af492fc3e2284a8a89ce96, ASSIGN}] 2023-02-09 05:02:48,149 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=75d93fd3b4af492fc3e2284a8a89ce96, ASSIGN 2023-02-09 05:02:48,152 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=75d93fd3b4af492fc3e2284a8a89ce96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:48,305 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:02:48,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=75d93fd3b4af492fc3e2284a8a89ce96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:48,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918968306"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918968306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918968306"}]},"ts":"1675918968306"} 2023-02-09 05:02:48,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 75d93fd3b4af492fc3e2284a8a89ce96, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:48,466 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:48,467 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:02:48,471 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39558, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:02:48,477 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34441%2C1675918964998, suffix=, logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,34441,1675918964998, archiveDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs, maxLogs=32 2023-02-09 05:02:48,504 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK] 2023-02-09 05:02:48,504 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK] 2023-02-09 05:02:48,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,34441,1675918964998/jenkins-hbase4.apache.org%2C34441%2C1675918964998.1675918968482 2023-02-09 05:02:48,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK], DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK]] 2023-02-09 05:02:48,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 75d93fd3b4af492fc3e2284a8a89ce96, NAME => 'hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:02:48,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:48,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,523 INFO [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40155%2C1675918965052, suffix=, logDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052, archiveDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs, maxLogs=32 2023-02-09 05:02:48,524 INFO [StoreOpener-75d93fd3b4af492fc3e2284a8a89ce96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,530 DEBUG [StoreOpener-75d93fd3b4af492fc3e2284a8a89ce96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/info 2023-02-09 05:02:48,531 DEBUG [StoreOpener-75d93fd3b4af492fc3e2284a8a89ce96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/info 2023-02-09 05:02:48,531 INFO [StoreOpener-75d93fd3b4af492fc3e2284a8a89ce96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75d93fd3b4af492fc3e2284a8a89ce96 columnFamilyName info 2023-02-09 05:02:48,532 INFO [StoreOpener-75d93fd3b4af492fc3e2284a8a89ce96-1] regionserver.HStore(310): Store=75d93fd3b4af492fc3e2284a8a89ce96/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:48,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:02:48,553 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:48,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 75d93fd3b4af492fc3e2284a8a89ce96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59737214, jitterRate=-0.10984614491462708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:02:48,554 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 75d93fd3b4af492fc3e2284a8a89ce96: Running coprocessor pre-open hook at 1675918968515Writing region info on filesystem at 1675918968515Initializing all the Stores at 1675918968517 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918968517Cleaning up temporary data from old regions at 1675918968536 (+19 ms)Cleaning up detritus from prior splits at 1675918968537 (+1 ms)Running coprocessor post-open hooks at 1675918968554 (+17 ms)Region opened successfully at 1675918968554 2023-02-09 05:02:48,560 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK] 2023-02-09 05:02:48,560 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK] 2023-02-09 05:02:48,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96., pid=6, masterSystemTime=1675918968466 2023-02-09 05:02:48,572 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=75d93fd3b4af492fc3e2284a8a89ce96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:48,573 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918968572"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918968572"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918968572"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918968572"}]},"ts":"1675918968572"} 2023-02-09 05:02:48,583 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,583 INFO [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052/jenkins-hbase4.apache.org%2C40155%2C1675918965052.1675918968524 2023-02-09 05:02:48,583 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:02:48,584 DEBUG [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42089,DS-11773edf-c643-4b44-893c-c20fb70c76d0,DISK], DatanodeInfoWithStorage[127.0.0.1:43335,DS-5a24b3f5-3ec5-4c56-b2a4-b56d63fc5174,DISK]] 2023-02-09 05:02:48,591 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:02:48,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 75d93fd3b4af492fc3e2284a8a89ce96, server=jenkins-hbase4.apache.org,34441,1675918964998 in 275 msec 2023-02-09 05:02:48,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:02:48,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=75d93fd3b4af492fc3e2284a8a89ce96, ASSIGN in 446 msec 2023-02-09 05:02:48,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:02:48,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918968598"}]},"ts":"1675918968598"} 2023-02-09 05:02:48,603 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:02:48,607 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:02:48,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 704 msec 2023-02-09 05:02:48,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:02:48,620 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:02:48,620 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:02:48,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:02:48,667 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:02:48,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:02:48,702 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:02:48,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-09 05:02:48,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:02:48,730 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:02:48,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-02-09 05:02:48,744 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:02:48,747 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:02:48,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.612sec 2023-02-09 05:02:48,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:02:48,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:02:48,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:02:48,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1675918963742-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:02:48,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46231,1675918963742-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:02:48,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:02:48,802 DEBUG [Listener at localhost/40479] zookeeper.ReadOnlyZKClient(139): Connect 0x29a3e046 to 127.0.0.1:63799 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:02:48,808 DEBUG [Listener at localhost/40479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@203d881a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:02:48,860 DEBUG [hconnection-0x716a3d41-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:02:48,872 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42008, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:02:48,883 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:02:48,884 DEBUG [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:02:48,886 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:48,886 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:48,895 DEBUG [Listener at localhost/40479] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:02:48,898 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:02:48,902 INFO [Listener at localhost/40479] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 05:02:48,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 05:02:48,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:02:48,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:44708 deadline: 1675919028906, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 05:02:48,910 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 05:02:48,911 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:48,911 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:48,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:02:48,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 05:02:48,929 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:02:48,931 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:02:48,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 05:02:48,944 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:48,944 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:48,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:48,953 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:48,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 empty. 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:48,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:48,955 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 empty. 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 empty. 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 empty. 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c empty. 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 empty. 2023-02-09 05:02:48,957 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 empty. 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 empty. 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:48,958 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 empty. 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d empty. 2023-02-09 05:02:48,959 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:48,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:48,960 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 05:02:48,985 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 05:02:48,988 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9c62132e4ef9cf0a5a152457d6bd78c2, NAME => 'testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:48,988 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1e87ed8f5222fbc0a0693ff6e4643f3c, NAME => 'testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:48,988 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f147cd0f1c2f15b7b26f0bbf3e6db224, NAME => 'testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1e87ed8f5222fbc0a0693ff6e4643f3c, disabling compactions & flushes 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 9c62132e4ef9cf0a5a152457d6bd78c2, disabling compactions & flushes 2023-02-09 05:02:49,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. after waiting 0 ms 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. after waiting 0 ms 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:49,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Waiting for close lock at 1675918969045Disabling compacts and flushes for region at 1675918969045Disabling writes for close at 1675918969045Writing region close event to WAL at 1675918969045Closed at 1675918969045 2023-02-09 05:02:49,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Waiting for close lock at 1675918969045Disabling compacts and flushes for region at 1675918969045Disabling writes for close at 1675918969045Writing region close event to WAL at 1675918969045Closed at 1675918969045 2023-02-09 05:02:49,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7e4c7dfa24f86a1ec65cb15c2ade8c45, NAME => 'testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 17b027fca1c2f0776917ce61b08ff155, NAME => 'testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,054 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:49,054 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:49,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:49,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,079 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 17b027fca1c2f0776917ce61b08ff155, disabling compactions & flushes 2023-02-09 05:02:49,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:49,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:49,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. after waiting 0 ms 2023-02-09 05:02:49,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:49,080 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:49,080 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 17b027fca1c2f0776917ce61b08ff155: Waiting for close lock at 1675918969079Disabling compacts and flushes for region at 1675918969079Disabling writes for close at 1675918969080 (+1 ms)Writing region close event to WAL at 1675918969080Closed at 1675918969080 2023-02-09 05:02:49,081 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2e5bfd3c3aa7141f6cecac5be2d64401, NAME => 'testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7e4c7dfa24f86a1ec65cb15c2ade8c45, disabling compactions & flushes 2023-02-09 05:02:49,082 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:49,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:49,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. after waiting 0 ms 2023-02-09 05:02:49,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:49,082 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:49,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Waiting for close lock at 1675918969082Disabling compacts and flushes for region at 1675918969082Disabling writes for close at 1675918969082Writing region close event to WAL at 1675918969082Closed at 1675918969082 2023-02-09 05:02:49,083 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3c8a28249336cf36d8d8434d419a7e21, NAME => 'testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,101 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,102 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 2e5bfd3c3aa7141f6cecac5be2d64401, disabling compactions & flushes 2023-02-09 05:02:49,102 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,102 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,102 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. after waiting 0 ms 2023-02-09 05:02:49,102 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,102 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,102 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Waiting for close lock at 1675918969102Disabling compacts and flushes for region at 1675918969102Disabling writes for close at 1675918969102Writing region close event to WAL at 1675918969102Closed at 1675918969102 2023-02-09 05:02:49,103 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0d53b6188118f1d68a68407cd3cef2d2, NAME => 'testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,103 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 3c8a28249336cf36d8d8434d419a7e21, disabling compactions & flushes 2023-02-09 05:02:49,104 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. after waiting 0 ms 2023-02-09 05:02:49,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,104 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 3c8a28249336cf36d8d8434d419a7e21: Waiting for close lock at 1675918969104Disabling compacts and flushes for region at 1675918969104Disabling writes for close at 1675918969104Writing region close event to WAL at 1675918969104Closed at 1675918969104 2023-02-09 05:02:49,105 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4fdbdca6810c01b7e476eac809009ee2, NAME => 'testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,135 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,135 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 4fdbdca6810c01b7e476eac809009ee2, disabling compactions & flushes 2023-02-09 05:02:49,136 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. after waiting 0 ms 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:49,136 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 4fdbdca6810c01b7e476eac809009ee2: Waiting for close lock at 1675918969136Disabling compacts and flushes for region at 1675918969136Disabling writes for close at 1675918969136Writing region close event to WAL at 1675918969136Closed at 1675918969136 2023-02-09 05:02:49,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0d53b6188118f1d68a68407cd3cef2d2, disabling compactions & flushes 2023-02-09 05:02:49,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:49,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:49,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => ac06087e1294746d47ae0d44332da21d, NAME => 'testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp 2023-02-09 05:02:49,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. after waiting 0 ms 2023-02-09 05:02:49,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:49,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:49,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0d53b6188118f1d68a68407cd3cef2d2: Waiting for close lock at 1675918969136Disabling compacts and flushes for region at 1675918969136Disabling writes for close at 1675918969137 (+1 ms)Writing region close event to WAL at 1675918969137Closed at 1675918969137 2023-02-09 05:02:49,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing ac06087e1294746d47ae0d44332da21d, disabling compactions & flushes 2023-02-09 05:02:49,153 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:49,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:49,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. after waiting 0 ms 2023-02-09 05:02:49,153 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:49,153 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:49,154 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for ac06087e1294746d47ae0d44332da21d: Waiting for close lock at 1675918969153Disabling compacts and flushes for region at 1675918969153Disabling writes for close at 1675918969153Writing region close event to WAL at 1675918969153Closed at 1675918969153 2023-02-09 05:02:49,266 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:49,266 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:49,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:49,446 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,446 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f147cd0f1c2f15b7b26f0bbf3e6db224, disabling compactions & flushes 2023-02-09 05:02:49,446 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,446 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,446 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. after waiting 0 ms 2023-02-09 05:02:49,446 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,446 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,447 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Waiting for close lock at 1675918969446Disabling compacts and flushes for region at 1675918969446Disabling writes for close at 1675918969446Writing region close event to WAL at 1675918969446Closed at 1675918969446 2023-02-09 05:02:49,453 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:02:49,455 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,455 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,455 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,456 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918969454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918969454"}]},"ts":"1675918969454"} 2023-02-09 05:02:49,512 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 05:02:49,514 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:02:49,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918969515"}]},"ts":"1675918969515"} 2023-02-09 05:02:49,518 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 05:02:49,522 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:02:49,537 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:02:49,538 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:02:49,538 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:02:49,539 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, ASSIGN}] 2023-02-09 05:02:49,543 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, ASSIGN 2023-02-09 05:02:49,543 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, ASSIGN 2023-02-09 05:02:49,544 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, ASSIGN 2023-02-09 05:02:49,544 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, ASSIGN 2023-02-09 05:02:49,546 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40155,1675918965052; forceNewPlan=false, retain=false 2023-02-09 05:02:49,546 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:49,546 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:49,547 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:49,548 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, ASSIGN 2023-02-09 05:02:49,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, ASSIGN 2023-02-09 05:02:49,549 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, ASSIGN 2023-02-09 05:02:49,549 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, ASSIGN 2023-02-09 05:02:49,549 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, ASSIGN 2023-02-09 05:02:49,550 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40155,1675918965052; forceNewPlan=false, retain=false 2023-02-09 05:02:49,550 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:49,550 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40155,1675918965052; forceNewPlan=false, retain=false 2023-02-09 05:02:49,550 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40155,1675918965052; forceNewPlan=false, retain=false 2023-02-09 05:02:49,550 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34441,1675918964998; forceNewPlan=false, retain=false 2023-02-09 05:02:49,552 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, ASSIGN 2023-02-09 05:02:49,553 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40155,1675918965052; forceNewPlan=false, retain=false 2023-02-09 05:02:49,569 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:49,569 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:49,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:49,696 INFO [jenkins-hbase4:46231] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 05:02:49,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2e5bfd3c3aa7141f6cecac5be2d64401, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,699 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1e87ed8f5222fbc0a0693ff6e4643f3c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,699 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ac06087e1294746d47ae0d44332da21d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,699 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=17b027fca1c2f0776917ce61b08ff155, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,699 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4fdbdca6810c01b7e476eac809009ee2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,699 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918969699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969699"}]},"ts":"1675918969699"} 2023-02-09 05:02:49,699 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969699"}]},"ts":"1675918969699"} 2023-02-09 05:02:49,700 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969699"}]},"ts":"1675918969699"} 2023-02-09 05:02:49,699 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969699"}]},"ts":"1675918969699"} 2023-02-09 05:02:49,700 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969699"}]},"ts":"1675918969699"} 2023-02-09 05:02:49,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=12, state=RUNNABLE; OpenRegionProcedure 1e87ed8f5222fbc0a0693ff6e4643f3c, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:49,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure ac06087e1294746d47ae0d44332da21d, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:49,706 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 17b027fca1c2f0776917ce61b08ff155, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:49,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 2e5bfd3c3aa7141f6cecac5be2d64401, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:49,709 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0d53b6188118f1d68a68407cd3cef2d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,710 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969709"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969709"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969709"}]},"ts":"1675918969709"} 2023-02-09 05:02:49,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 4fdbdca6810c01b7e476eac809009ee2, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:49,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7e4c7dfa24f86a1ec65cb15c2ade8c45, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969711"}]},"ts":"1675918969711"} 2023-02-09 05:02:49,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 0d53b6188118f1d68a68407cd3cef2d2, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:49,713 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3c8a28249336cf36d8d8434d419a7e21, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,713 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969713"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969713"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969713"}]},"ts":"1675918969713"} 2023-02-09 05:02:49,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 7e4c7dfa24f86a1ec65cb15c2ade8c45, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:49,716 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c62132e4ef9cf0a5a152457d6bd78c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969716"}]},"ts":"1675918969716"} 2023-02-09 05:02:49,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 3c8a28249336cf36d8d8434d419a7e21, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:49,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f147cd0f1c2f15b7b26f0bbf3e6db224, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,725 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918969725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918969725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918969725"}]},"ts":"1675918969725"} 2023-02-09 05:02:49,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 9c62132e4ef9cf0a5a152457d6bd78c2, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:49,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure f147cd0f1c2f15b7b26f0bbf3e6db224, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:49,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2e5bfd3c3aa7141f6cecac5be2d64401, NAME => 'testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 05:02:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,868 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,871 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1 2023-02-09 05:02:49,871 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1 2023-02-09 05:02:49,871 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e5bfd3c3aa7141f6cecac5be2d64401 columnFamilyName f1 2023-02-09 05:02:49,872 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(310): Store=2e5bfd3c3aa7141f6cecac5be2d64401/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,873 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,878 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2 2023-02-09 05:02:49,878 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2 2023-02-09 05:02:49,879 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e5bfd3c3aa7141f6cecac5be2d64401 columnFamilyName f2 2023-02-09 05:02:49,879 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(310): Store=2e5bfd3c3aa7141f6cecac5be2d64401/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f147cd0f1c2f15b7b26f0bbf3e6db224, NAME => 'testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 05:02:49,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,886 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:49,888 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f1 2023-02-09 05:02:49,888 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f1 2023-02-09 05:02:49,889 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f147cd0f1c2f15b7b26f0bbf3e6db224 columnFamilyName f1 2023-02-09 05:02:49,890 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(310): Store=f147cd0f1c2f15b7b26f0bbf3e6db224/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,890 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,892 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f2 2023-02-09 05:02:49,892 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f2 2023-02-09 05:02:49,892 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f147cd0f1c2f15b7b26f0bbf3e6db224 columnFamilyName f2 2023-02-09 05:02:49,893 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(310): Store=f147cd0f1c2f15b7b26f0bbf3e6db224/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:49,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:49,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2e5bfd3c3aa7141f6cecac5be2d64401; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72814898, jitterRate=0.08502653241157532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:49,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Running coprocessor pre-open hook at 1675918969866Writing region info on filesystem at 1675918969866Initializing all the Stores at 1675918969868 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969868Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969868Cleaning up temporary data from old regions at 1675918969885 (+17 ms)Cleaning up detritus from prior splits at 1675918969885Running coprocessor post-open hooks at 1675918969936 (+51 ms)Region opened successfully at 1675918969936 2023-02-09 05:02:49,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:49,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401., pid=24, masterSystemTime=1675918969857 2023-02-09 05:02:49,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:49,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,941 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:49,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2e5bfd3c3aa7141f6cecac5be2d64401, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,943 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918969943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918969943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918969943"}]},"ts":"1675918969943"} 2023-02-09 05:02:49,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:49,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f147cd0f1c2f15b7b26f0bbf3e6db224; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63512819, jitterRate=-0.053585246205329895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:49,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1e87ed8f5222fbc0a0693ff6e4643f3c, NAME => 'testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 05:02:49,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Running coprocessor pre-open hook at 1675918969884Writing region info on filesystem at 1675918969884Initializing all the Stores at 1675918969885 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969886 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969886Cleaning up temporary data from old regions at 1675918969898 (+12 ms)Cleaning up detritus from prior splits at 1675918969930 (+32 ms)Running coprocessor post-open hooks at 1675918969945 (+15 ms)Region opened successfully at 1675918969945 2023-02-09 05:02:49,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224., pid=30, masterSystemTime=1675918969875 2023-02-09 05:02:49,949 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:49,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c8a28249336cf36d8d8434d419a7e21, NAME => 'testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 05:02:49,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f147cd0f1c2f15b7b26f0bbf3e6db224, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918969950"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918969950"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918969950"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918969950"}]},"ts":"1675918969950"} 2023-02-09 05:02:49,952 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1 2023-02-09 05:02:49,952 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-09 05:02:49,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 2e5bfd3c3aa7141f6cecac5be2d64401, server=jenkins-hbase4.apache.org,40155,1675918965052 in 240 msec 2023-02-09 05:02:49,952 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1 2023-02-09 05:02:49,953 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,954 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e87ed8f5222fbc0a0693ff6e4643f3c columnFamilyName f1 2023-02-09 05:02:49,955 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(310): Store=1e87ed8f5222fbc0a0693ff6e4643f3c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,955 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,956 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1 2023-02-09 05:02:49,956 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1 2023-02-09 05:02:49,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, ASSIGN in 414 msec 2023-02-09 05:02:49,957 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8a28249336cf36d8d8434d419a7e21 columnFamilyName f1 2023-02-09 05:02:49,958 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(310): Store=3c8a28249336cf36d8d8434d419a7e21/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,958 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2 2023-02-09 05:02:49,958 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2 2023-02-09 05:02:49,958 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,960 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e87ed8f5222fbc0a0693ff6e4643f3c columnFamilyName f2 2023-02-09 05:02:49,961 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2 2023-02-09 05:02:49,961 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2 2023-02-09 05:02:49,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-09 05:02:49,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure f147cd0f1c2f15b7b26f0bbf3e6db224, server=jenkins-hbase4.apache.org,34441,1675918964998 in 221 msec 2023-02-09 05:02:49,962 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(310): Store=1e87ed8f5222fbc0a0693ff6e4643f3c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,964 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8a28249336cf36d8d8434d419a7e21 columnFamilyName f2 2023-02-09 05:02:49,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, ASSIGN in 424 msec 2023-02-09 05:02:49,966 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(310): Store=3c8a28249336cf36d8d8434d419a7e21/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:49,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:49,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:49,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:49,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:49,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1e87ed8f5222fbc0a0693ff6e4643f3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66061946, jitterRate=-0.0156002938747406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:49,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Running coprocessor pre-open hook at 1675918969946Writing region info on filesystem at 1675918969946Initializing all the Stores at 1675918969948 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969948Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969949 (+1 ms)Cleaning up temporary data from old regions at 1675918969966 (+17 ms)Cleaning up detritus from prior splits at 1675918969967 (+1 ms)Running coprocessor post-open hooks at 1675918969978 (+11 ms)Region opened successfully at 1675918969978 2023-02-09 05:02:49,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c., pid=21, masterSystemTime=1675918969857 2023-02-09 05:02:49,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:49,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:49,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fdbdca6810c01b7e476eac809009ee2, NAME => 'testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 05:02:49,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:49,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,984 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1e87ed8f5222fbc0a0693ff6e4643f3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:49,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,984 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969984"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918969984"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918969984"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918969984"}]},"ts":"1675918969984"} 2023-02-09 05:02:49,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3c8a28249336cf36d8d8434d419a7e21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61853447, jitterRate=-0.07831181585788727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:49,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3c8a28249336cf36d8d8434d419a7e21: Running coprocessor pre-open hook at 1675918969951Writing region info on filesystem at 1675918969951Initializing all the Stores at 1675918969953 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969953Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969953Cleaning up temporary data from old regions at 1675918969971 (+18 ms)Cleaning up detritus from prior splits at 1675918969973 (+2 ms)Running coprocessor post-open hooks at 1675918969985 (+12 ms)Region opened successfully at 1675918969985 2023-02-09 05:02:49,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21., pid=28, masterSystemTime=1675918969875 2023-02-09 05:02:49,987 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,990 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1 2023-02-09 05:02:49,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,990 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1 2023-02-09 05:02:49,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:49,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:49,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c62132e4ef9cf0a5a152457d6bd78c2, NAME => 'testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 05:02:49,990 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdbdca6810c01b7e476eac809009ee2 columnFamilyName f1 2023-02-09 05:02:49,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:49,991 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=3c8a28249336cf36d8d8434d419a7e21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:49,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:49,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:49,991 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918969990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918969990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918969990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918969990"}]},"ts":"1675918969990"} 2023-02-09 05:02:49,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:49,992 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(310): Store=4fdbdca6810c01b7e476eac809009ee2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=12 2023-02-09 05:02:49,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=12, state=SUCCESS; OpenRegionProcedure 1e87ed8f5222fbc0a0693ff6e4643f3c, server=jenkins-hbase4.apache.org,40155,1675918965052 in 285 msec 2023-02-09 05:02:49,994 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,996 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:49,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, ASSIGN in 456 msec 2023-02-09 05:02:49,996 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2 2023-02-09 05:02:49,996 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2 2023-02-09 05:02:49,997 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdbdca6810c01b7e476eac809009ee2 columnFamilyName f2 2023-02-09 05:02:49,998 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(310): Store=4fdbdca6810c01b7e476eac809009ee2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:49,999 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1 2023-02-09 05:02:49,999 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1 2023-02-09 05:02:49,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:49,999 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c62132e4ef9cf0a5a152457d6bd78c2 columnFamilyName f1 2023-02-09 05:02:50,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-09 05:02:50,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:50,001 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 3c8a28249336cf36d8d8434d419a7e21, server=jenkins-hbase4.apache.org,34441,1675918964998 in 272 msec 2023-02-09 05:02:50,001 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(310): Store=9c62132e4ef9cf0a5a152457d6bd78c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,002 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:50,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, ASSIGN in 463 msec 2023-02-09 05:02:50,004 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2 2023-02-09 05:02:50,004 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2 2023-02-09 05:02:50,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,004 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c62132e4ef9cf0a5a152457d6bd78c2 columnFamilyName f2 2023-02-09 05:02:50,006 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(310): Store=9c62132e4ef9cf0a5a152457d6bd78c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:50,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:50,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:50,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:50,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fdbdca6810c01b7e476eac809009ee2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65338577, jitterRate=-0.026379331946372986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fdbdca6810c01b7e476eac809009ee2: Running coprocessor pre-open hook at 1675918969984Writing region info on filesystem at 1675918969984Initializing all the Stores at 1675918969987 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969987Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969987Cleaning up temporary data from old regions at 1675918970002 (+15 ms)Cleaning up detritus from prior splits at 1675918970003 (+1 ms)Running coprocessor post-open hooks at 1675918970024 (+21 ms)Region opened successfully at 1675918970024 2023-02-09 05:02:50,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c62132e4ef9cf0a5a152457d6bd78c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73261378, jitterRate=0.09167960286140442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Running coprocessor pre-open hook at 1675918969993Writing region info on filesystem at 1675918969993Initializing all the Stores at 1675918969995 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969995Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918969996 (+1 ms)Cleaning up temporary data from old regions at 1675918970010 (+14 ms)Cleaning up detritus from prior splits at 1675918970010Running coprocessor post-open hooks at 1675918970025 (+15 ms)Region opened successfully at 1675918970025 2023-02-09 05:02:50,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2., pid=25, masterSystemTime=1675918969857 2023-02-09 05:02:50,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:50,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:50,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:50,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ac06087e1294746d47ae0d44332da21d, NAME => 'testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 05:02:50,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:50,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2., pid=29, masterSystemTime=1675918969875 2023-02-09 05:02:50,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,030 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4fdbdca6810c01b7e476eac809009ee2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:50,030 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918970029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970029"}]},"ts":"1675918970029"} 2023-02-09 05:02:50,031 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:50,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:50,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:50,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0d53b6188118f1d68a68407cd3cef2d2, NAME => 'testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 05:02:50,033 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=9c62132e4ef9cf0a5a152457d6bd78c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:50,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,033 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918970033"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970033"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970033"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970033"}]},"ts":"1675918970033"} 2023-02-09 05:02:50,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:50,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,034 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f1 2023-02-09 05:02:50,034 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f1 2023-02-09 05:02:50,035 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac06087e1294746d47ae0d44332da21d columnFamilyName f1 2023-02-09 05:02:50,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-09 05:02:50,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 4fdbdca6810c01b7e476eac809009ee2, server=jenkins-hbase4.apache.org,40155,1675918965052 in 323 msec 2023-02-09 05:02:50,037 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(310): Store=ac06087e1294746d47ae0d44332da21d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,037 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,038 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, ASSIGN in 498 msec 2023-02-09 05:02:50,041 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f2 2023-02-09 05:02:50,041 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f2 2023-02-09 05:02:50,042 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac06087e1294746d47ae0d44332da21d columnFamilyName f2 2023-02-09 05:02:50,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-09 05:02:50,042 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1 2023-02-09 05:02:50,042 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1 2023-02-09 05:02:50,043 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d53b6188118f1d68a68407cd3cef2d2 columnFamilyName f1 2023-02-09 05:02:50,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 9c62132e4ef9cf0a5a152457d6bd78c2, server=jenkins-hbase4.apache.org,34441,1675918964998 in 310 msec 2023-02-09 05:02:50,043 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(310): Store=ac06087e1294746d47ae0d44332da21d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,044 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(310): Store=0d53b6188118f1d68a68407cd3cef2d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,045 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, ASSIGN in 504 msec 2023-02-09 05:02:50,046 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,050 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2 2023-02-09 05:02:50,050 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2 2023-02-09 05:02:50,051 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d53b6188118f1d68a68407cd3cef2d2 columnFamilyName f2 2023-02-09 05:02:50,051 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(310): Store=0d53b6188118f1d68a68407cd3cef2d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:50,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ac06087e1294746d47ae0d44332da21d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59699402, jitterRate=-0.11040958762168884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ac06087e1294746d47ae0d44332da21d: Running coprocessor pre-open hook at 1675918970030Writing region info on filesystem at 1675918970030Initializing all the Stores at 1675918970031 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970031Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970031Cleaning up temporary data from old regions at 1675918970047 (+16 ms)Cleaning up detritus from prior splits at 1675918970048 (+1 ms)Running coprocessor post-open hooks at 1675918970056 (+8 ms)Region opened successfully at 1675918970056 2023-02-09 05:02:50,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d., pid=22, masterSystemTime=1675918969857 2023-02-09 05:02:50,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:50,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:50,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:50,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:50,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 17b027fca1c2f0776917ce61b08ff155, NAME => 'testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 05:02:50,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:50,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ac06087e1294746d47ae0d44332da21d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:50,063 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918970063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970063"}]},"ts":"1675918970063"} 2023-02-09 05:02:50,063 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0d53b6188118f1d68a68407cd3cef2d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66873644, jitterRate=-0.0035050511360168457}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0d53b6188118f1d68a68407cd3cef2d2: Running coprocessor pre-open hook at 1675918970034Writing region info on filesystem at 1675918970034Initializing all the Stores at 1675918970037 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970037Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970037Cleaning up temporary data from old regions at 1675918970055 (+18 ms)Cleaning up detritus from prior splits at 1675918970056 (+1 ms)Running coprocessor post-open hooks at 1675918970065 (+9 ms)Region opened successfully at 1675918970065 2023-02-09 05:02:50,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2., pid=26, masterSystemTime=1675918969875 2023-02-09 05:02:50,067 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1 2023-02-09 05:02:50,067 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1 2023-02-09 05:02:50,067 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b027fca1c2f0776917ce61b08ff155 columnFamilyName f1 2023-02-09 05:02:50,068 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(310): Store=17b027fca1c2f0776917ce61b08ff155/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,069 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:50,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:50,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:50,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e4c7dfa24f86a1ec65cb15c2ade8c45, NAME => 'testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 05:02:50,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:50,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,071 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:50,071 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:50,071 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0d53b6188118f1d68a68407cd3cef2d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:50,071 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2 2023-02-09 05:02:50,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-09 05:02:50,071 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918970071"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970071"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970071"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970071"}]},"ts":"1675918970071"} 2023-02-09 05:02:50,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure ac06087e1294746d47ae0d44332da21d, server=jenkins-hbase4.apache.org,40155,1675918965052 in 361 msec 2023-02-09 05:02:50,071 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2 2023-02-09 05:02:50,072 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b027fca1c2f0776917ce61b08ff155 columnFamilyName f2 2023-02-09 05:02:50,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:50,073 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,073 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(310): Store=17b027fca1c2f0776917ce61b08ff155/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, ASSIGN in 533 msec 2023-02-09 05:02:50,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,076 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1 2023-02-09 05:02:50,077 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1 2023-02-09 05:02:50,077 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e4c7dfa24f86a1ec65cb15c2ade8c45 columnFamilyName f1 2023-02-09 05:02:50,078 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(310): Store=7e4c7dfa24f86a1ec65cb15c2ade8c45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,078 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-09 05:02:50,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 0d53b6188118f1d68a68407cd3cef2d2, server=jenkins-hbase4.apache.org,34441,1675918964998 in 362 msec 2023-02-09 05:02:50,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,080 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2 2023-02-09 05:02:50,081 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2 2023-02-09 05:02:50,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, ASSIGN in 541 msec 2023-02-09 05:02:50,081 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e4c7dfa24f86a1ec65cb15c2ade8c45 columnFamilyName f2 2023-02-09 05:02:50,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:50,083 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(310): Store=7e4c7dfa24f86a1ec65cb15c2ade8c45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:50,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 17b027fca1c2f0776917ce61b08ff155; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72422315, jitterRate=0.07917658984661102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 17b027fca1c2f0776917ce61b08ff155: Running coprocessor pre-open hook at 1675918970062Writing region info on filesystem at 1675918970062Initializing all the Stores at 1675918970063 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970063Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970063Cleaning up temporary data from old regions at 1675918970077 (+14 ms)Cleaning up detritus from prior splits at 1675918970078 (+1 ms)Running coprocessor post-open hooks at 1675918970088 (+10 ms)Region opened successfully at 1675918970088 2023-02-09 05:02:50,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:50,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155., pid=23, masterSystemTime=1675918969857 2023-02-09 05:02:50,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:50,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:50,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:50,094 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=17b027fca1c2f0776917ce61b08ff155, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:50,094 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918970094"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970094"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970094"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970094"}]},"ts":"1675918970094"} 2023-02-09 05:02:50,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:02:50,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7e4c7dfa24f86a1ec65cb15c2ade8c45; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71561675, jitterRate=0.06635205447673798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:50,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Running coprocessor pre-open hook at 1675918970070Writing region info on filesystem at 1675918970070Initializing all the Stores at 1675918970072 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970073 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918970073Cleaning up temporary data from old regions at 1675918970087 (+14 ms)Cleaning up detritus from prior splits at 1675918970088 (+1 ms)Running coprocessor post-open hooks at 1675918970097 (+9 ms)Region opened successfully at 1675918970097 2023-02-09 05:02:50,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45., pid=27, masterSystemTime=1675918969875 2023-02-09 05:02:50,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:50,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:50,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=7e4c7dfa24f86a1ec65cb15c2ade8c45, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:50,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-09 05:02:50,102 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918970101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918970101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918970101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918970101"}]},"ts":"1675918970101"} 2023-02-09 05:02:50,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 17b027fca1c2f0776917ce61b08ff155, server=jenkins-hbase4.apache.org,40155,1675918965052 in 392 msec 2023-02-09 05:02:50,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, ASSIGN in 564 msec 2023-02-09 05:02:50,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-09 05:02:50,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 7e4c7dfa24f86a1ec65cb15c2ade8c45, server=jenkins-hbase4.apache.org,34441,1675918964998 in 389 msec 2023-02-09 05:02:50,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-09 05:02:50,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, ASSIGN in 570 msec 2023-02-09 05:02:50,112 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:02:50,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918970112"}]},"ts":"1675918970112"} 2023-02-09 05:02:50,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 05:02:50,118 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:02:50,123 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 1.1950 sec 2023-02-09 05:02:51,075 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:51,075 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:51,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:02:51,077 INFO [Listener at localhost/40479] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 05:02:51,078 DEBUG [Listener at localhost/40479] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 05:02:51,079 INFO [Listener at localhost/40479] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:02:51,088 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 05:02:51,089 INFO [Listener at localhost/40479] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:02:51,089 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 05:02:51,089 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:02:51,221 DEBUG [hconnection-0x716a3d41-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:02:51,272 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39576, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:02:51,306 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34441] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:51,312 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40155] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:51,609 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:02:51,613 INFO [Listener at localhost/40479] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:02:51,625 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:51,625 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:51,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:02:51,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675918971628 (current time:1675918971628). 2023-02-09 05:02:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:02:51,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(139): Connect 0x1835600c to 127.0.0.1:63799 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:02:51,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3710a0f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:02:51,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:02:51,642 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42020, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:02:51,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1835600c to 127.0.0.1:63799 2023-02-09 05:02:51,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:02:51,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:02:51,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:02:51,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:02:51,675 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:02:51,677 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675919571677 2023-02-09 05:02:51,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:02:51,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 05:02:51,680 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:02:51,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:02:51,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 17 msec 2023-02-09 05:02:51,683 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:02:51,684 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675919571684 2023-02-09 05:02:51,684 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:02:51,684 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:02:51,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-09 05:02:51,716 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-09 05:02:51,716 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:02:51,716 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-09 05:02:51,717 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 05:02:51,717 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:51,717 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:51,720 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:02:51,720 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:02:51,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:51,720 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:02:51,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:02:51,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:51,720 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,720 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:51,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:51,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:51,722 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,722 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 05:02:51,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 05:02:51,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 05:02:51,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-09 05:02:51,726 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 05:02:51,726 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-09 05:02:51,726 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:02:51,726 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:02:51,726 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:02:51,727 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:02:51,727 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 05:02:51,727 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-09 05:02:51,727 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34441,1675918964998' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 05:02:51,727 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40155,1675918965052' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-09 05:02:51,730 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,730 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:02:51,730 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,730 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,730 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:51,730 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:02:51,731 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,731 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:02:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:51,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34441,1675918964998' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@262a4746[Count = 1] remaining members to acquire global barrier 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:02:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:51,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:51,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40155,1675918965052' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-09 05:02:51,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@262a4746[Count = 0] remaining members to acquire global barrier 2023-02-09 05:02:51,736 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 05:02:51,736 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:51,738 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:02:51,738 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:02:51,739 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:51,739 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:51,739 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:02:51,739 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. started... 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. started... 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. started... 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:51,740 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:51,741 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:02:51,741 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. started... 2023-02-09 05:02:51,740 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. started... 2023-02-09 05:02:51,744 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:02:51,745 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:02:51,745 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 4fdbdca6810c01b7e476eac809009ee2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:02:51,745 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1e87ed8f5222fbc0a0693ff6e4643f3c 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:02:51,745 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7e4c7dfa24f86a1ec65cb15c2ade8c45 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:51,745 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 17b027fca1c2f0776917ce61b08ff155 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:51,745 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:51,745 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 0d53b6188118f1d68a68407cd3cef2d2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:51,745 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. started... 2023-02-09 05:02:51,746 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3c8a28249336cf36d8d8434d419a7e21 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:51,785 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:02:51,786 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:51,786 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:51,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:02:51,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:02:51,790 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:02:51,946 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f1/5599569411b9402a9fa8b222027a59b2 2023-02-09 05:02:51,952 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f1/60b183d364b943209c619afbff5491c3 2023-02-09 05:02:51,984 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f1/46895f65ac034981aeb07f5f185d6971 2023-02-09 05:02:51,986 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f1/f396241a35bc47a285e0c708024148ca 2023-02-09 05:02:51,990 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:02:51,990 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:51,991 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:51,992 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f1/54643437399849afb46179bbfeca8e68 2023-02-09 05:02:51,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:02:51,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:02:51,993 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 05:02:52,111 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f2/496ae18f452d4e3e9669b37f30a5e362 2023-02-09 05:02:52,114 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f2/02081774c7274f129b8e197e2b0a8637 2023-02-09 05:02:52,118 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f2/fe4893f5fb664de8ab700b6ef5d4b97d 2023-02-09 05:02:52,126 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f2/d10e66d7856746599ad554995c4a7888 2023-02-09 05:02:52,129 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f1/5599569411b9402a9fa8b222027a59b2 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2 2023-02-09 05:02:52,130 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f1/54643437399849afb46179bbfeca8e68 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68 2023-02-09 05:02:52,133 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f1/46895f65ac034981aeb07f5f185d6971 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971 2023-02-09 05:02:52,144 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f1/60b183d364b943209c619afbff5491c3 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3 2023-02-09 05:02:52,144 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,145 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,147 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:02:52,148 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f2/fe4893f5fb664de8ab700b6ef5d4b97d as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d 2023-02-09 05:02:52,148 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f2/02081774c7274f129b8e197e2b0a8637 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637 2023-02-09 05:02:52,150 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f2/496ae18f452d4e3e9669b37f30a5e362 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362 2023-02-09 05:02:52,156 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:02:52,157 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,157 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f2/d10e66d7856746599ad554995c4a7888 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888 2023-02-09 05:02:52,159 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7e4c7dfa24f86a1ec65cb15c2ade8c45 in 414ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,161 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 05:02:52,163 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,164 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: 2023-02-09 05:02:52,165 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0d53b6188118f1d68a68407cd3cef2d2 in 421ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,166 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 0d53b6188118f1d68a68407cd3cef2d2: 2023-02-09 05:02:52,166 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,166 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,168 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:02:52,169 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:02:52,170 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1e87ed8f5222fbc0a0693ff6e4643f3c in 425ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,170 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: 2023-02-09 05:02:52,170 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4fdbdca6810c01b7e476eac809009ee2 in 426ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,170 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,170 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4fdbdca6810c01b7e476eac809009ee2: 2023-02-09 05:02:52,170 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,172 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3] hfiles 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971] hfiles 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68] hfiles 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2] hfiles 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,175 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888] hfiles 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637] hfiles 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362] hfiles 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d] hfiles 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,179 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,216 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. completed. 2023-02-09 05:02:52,216 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. completed. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. completed. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. completed. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. started... 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:52,218 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:52,219 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:02:52,219 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:02:52,219 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:52,219 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2e5bfd3c3aa7141f6cecac5be2d64401 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:52,219 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:02:52,218 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. started... 2023-02-09 05:02:52,219 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. started... 2023-02-09 05:02:52,219 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:52,220 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ac06087e1294746d47ae0d44332da21d: 2023-02-09 05:02:52,220 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 9c62132e4ef9cf0a5a152457d6bd78c2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:02:52,221 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,221 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,221 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:02:52,221 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:02:52,220 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. started... 2023-02-09 05:02:52,222 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f147cd0f1c2f15b7b26f0bbf3e6db224: 2023-02-09 05:02:52,222 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,222 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,222 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:02:52,222 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:02:52,253 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. completed. 2023-02-09 05:02:52,253 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:52,253 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:02:52,265 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. completed. 2023-02-09 05:02:52,266 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:52,266 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:02:52,266 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f 2023-02-09 05:02:52,270 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f1/28b6923310f04667b791122b1e41bb04 2023-02-09 05:02:52,293 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:02:52,293 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:52,294 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:52,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:02:52,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:02:52,297 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 05:02:52,297 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f2/5eff2462c3734eb7ba850bb771dc3820 2023-02-09 05:02:52,298 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f2/79cd5c631bdd44f99048f031213898f3 2023-02-09 05:02:52,307 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f 2023-02-09 05:02:52,307 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f1/28b6923310f04667b791122b1e41bb04 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04 2023-02-09 05:02:52,317 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,317 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,319 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f2/5eff2462c3734eb7ba850bb771dc3820 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820 2023-02-09 05:02:52,319 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f2/79cd5c631bdd44f99048f031213898f3 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3 2023-02-09 05:02:52,326 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,326 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,327 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2e5bfd3c3aa7141f6cecac5be2d64401 in 108ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,327 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9c62132e4ef9cf0a5a152457d6bd78c2 in 107ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2e5bfd3c3aa7141f6cecac5be2d64401: 2023-02-09 05:02:52,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9c62132e4ef9cf0a5a152457d6bd78c2: 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f] hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04] hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820] hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3] hfiles 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,328 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,350 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. completed. 2023-02-09 05:02:52,350 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:52,350 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:02:52,352 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. completed. 2023-02-09 05:02:52,352 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:52,352 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:02:52,383 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f1/b79951f5d5bd413081bc111373205103 2023-02-09 05:02:52,509 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f2/67741e04ea3444f695c4f51ed1180588 2023-02-09 05:02:52,517 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f1/f396241a35bc47a285e0c708024148ca as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca 2023-02-09 05:02:52,526 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,527 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f2/67741e04ea3444f695c4f51ed1180588 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588 2023-02-09 05:02:52,534 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,535 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3c8a28249336cf36d8d8434d419a7e21 in 789ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3c8a28249336cf36d8d8434d419a7e21: 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca] hfiles 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588] hfiles 2023-02-09 05:02:52,536 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,550 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. completed. 2023-02-09 05:02:52,551 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:02:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:02:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 05:02:52,551 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,34441,1675918964998' in zk 2023-02-09 05:02:52,555 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:02:52,555 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,556 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:52,556 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 05:02:52,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:02:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:52,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:52,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,34441,1675918964998': 2023-02-09 05:02:52,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34441,1675918964998' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 05:02:52,797 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:02:52,797 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:52,797 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:52,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:02:52,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:02:52,799 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 05:02:52,810 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f2/283c0bcb328941f7addbff6a3e098a14 2023-02-09 05:02:52,820 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f1/b79951f5d5bd413081bc111373205103 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103 2023-02-09 05:02:52,828 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,829 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f2/283c0bcb328941f7addbff6a3e098a14 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14 2023-02-09 05:02:52,837 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:02:52,838 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 17b027fca1c2f0776917ce61b08ff155 in 1094ms, sequenceid=5, compaction requested=false 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 17b027fca1c2f0776917ce61b08ff155: 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103] hfiles 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,838 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14] hfiles 2023-02-09 05:02:52,839 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14 for snapshot=testWithMapReduceMultiRegion 2023-02-09 05:02:52,848 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. completed. 2023-02-09 05:02:52,848 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:02:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:02:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-09 05:02:52,848 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,40155,1675918965052' in zk 2023-02-09 05:02:52,850 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,850 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:02:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:02:52,851 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:52,851 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-09 05:02:52,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:52,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,40155,1675918965052': 2023-02-09 05:02:52,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40155,1675918965052' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 05:02:52,856 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-09 05:02:52,856 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:02:52,856 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:02:52,856 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-09 05:02:52,856 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:02:52,858 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,858 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,858 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:02:52,858 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,859 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:02:52,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,859 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:02:52,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:52,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:02:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,860 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,862 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,863 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-09 05:02:52,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,881 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,881 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:02:52,882 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:02:52,882 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:02:52,881 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:52,882 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-09 05:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:02:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:02:52,882 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:02:52,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-09 05:02:52,882 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:52,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:02:52,882 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-09 05:02:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:52,883 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:52,883 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:52,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:02:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:02:52,883 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:52,883 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-09 05:02:52,883 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-09 05:02:52,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 05:02:52,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-09 05:02:52,984 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-09 05:02:52,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 05:02:52,985 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-09 05:02:52,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675918971678Consolidate snapshot: testWithMapReduceMultiRegion at 1675918972882 (+1204 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675918972883 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1675918972906 (+23 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675918972924 (+18 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675918972984 (+60 ms) 2023-02-09 05:02:52,986 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:02:52,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3070 sec 2023-02-09 05:02:53,212 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 05:02:53,419 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 05:02:53,420 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 05:02:53,799 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:02:53,800 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:53,800 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:53,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:02:53,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:02:53,802 INFO [Listener at localhost/40479] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:02:53,803 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:53,803 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:53,813 INFO [Listener at localhost/40479] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:02:53,827 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:02:53,907 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40155] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:53,916 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:02:53,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34441] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:53,917 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 05:02:54,106 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:02:54,118 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:54,118 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:54,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:02:54,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 05:02:54,126 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 05:02:54,126 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:02:54,126 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 05:02:54,127 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 05:02:54,127 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,127 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,129 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:02:54,129 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:02:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:54,129 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:02:54,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:02:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,129 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,129 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,130 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,130 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:02:54,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:02:54,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:02:54,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:02:54,132 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:02:54,132 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:02:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:02:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:02:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:02:54,133 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. started... 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. started... 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:54,134 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:02:54,134 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:02:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:54,134 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:54,135 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. started... 2023-02-09 05:02:54,135 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. started... 2023-02-09 05:02:54,135 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:02:54,135 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0d53b6188118f1d68a68407cd3cef2d2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,135 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. started... 2023-02-09 05:02:54,135 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4fdbdca6810c01b7e476eac809009ee2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:02:54,135 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 17b027fca1c2f0776917ce61b08ff155 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,135 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e4c7dfa24f86a1ec65cb15c2ade8c45 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,135 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. started... 2023-02-09 05:02:54,136 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c8a28249336cf36d8d8434d419a7e21 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,135 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1e87ed8f5222fbc0a0693ff6e4643f3c 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:02:54,224 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f1/b69e474f0ed6472a953a77bab8818ecf 2023-02-09 05:02:54,226 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f1/4aeb0422c5f642578fd7a9274baf8b06 2023-02-09 05:02:54,227 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f1/3430594b2a62443aa523526b5b722560 2023-02-09 05:02:54,227 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f1/837f257e55a24916aee2e8652c2df8f1 2023-02-09 05:02:54,257 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f1/f7b66c1d6b4d489b9b31fa9e36264662 2023-02-09 05:02:54,264 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f2/56bf3719d8e549b5a5f3b3bb552fc4ac 2023-02-09 05:02:54,271 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f1/b69e474f0ed6472a953a77bab8818ecf as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/b69e474f0ed6472a953a77bab8818ecf 2023-02-09 05:02:54,280 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f2/44f2e7e9e0654d29a3c14d572d16901a 2023-02-09 05:02:54,281 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/b69e474f0ed6472a953a77bab8818ecf, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:02:54,282 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/.tmp/f2/56bf3719d8e549b5a5f3b3bb552fc4ac as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/56bf3719d8e549b5a5f3b3bb552fc4ac 2023-02-09 05:02:54,285 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f2/35a196a4032f419a9ef121f6eb14ecc8 2023-02-09 05:02:54,286 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f2/74c9196bf7ed4905a818232035fd62c9 2023-02-09 05:02:54,291 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f1/837f257e55a24916aee2e8652c2df8f1 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/837f257e55a24916aee2e8652c2df8f1 2023-02-09 05:02:54,292 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f2/bd673a26c227467bac7fa12124cc3eaf 2023-02-09 05:02:54,296 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f1/3430594b2a62443aa523526b5b722560 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/3430594b2a62443aa523526b5b722560 2023-02-09 05:02:54,297 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f1/4aeb0422c5f642578fd7a9274baf8b06 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/4aeb0422c5f642578fd7a9274baf8b06 2023-02-09 05:02:54,297 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/56bf3719d8e549b5a5f3b3bb552fc4ac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:02:54,299 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1e87ed8f5222fbc0a0693ff6e4643f3c in 164ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,299 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: 2023-02-09 05:02:54,299 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:54,299 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:54,299 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. started... 2023-02-09 05:02:54,299 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2e5bfd3c3aa7141f6cecac5be2d64401 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,300 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:02:54,301 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/837f257e55a24916aee2e8652c2df8f1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,304 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f1/f7b66c1d6b4d489b9b31fa9e36264662 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/f7b66c1d6b4d489b9b31fa9e36264662 2023-02-09 05:02:54,305 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/.tmp/f2/44f2e7e9e0654d29a3c14d572d16901a as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/44f2e7e9e0654d29a3c14d572d16901a 2023-02-09 05:02:54,307 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/3430594b2a62443aa523526b5b722560, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:02:54,312 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/.tmp/f2/35a196a4032f419a9ef121f6eb14ecc8 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/35a196a4032f419a9ef121f6eb14ecc8 2023-02-09 05:02:54,314 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/4aeb0422c5f642578fd7a9274baf8b06, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,316 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/.tmp/f2/74c9196bf7ed4905a818232035fd62c9 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/74c9196bf7ed4905a818232035fd62c9 2023-02-09 05:02:54,319 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/f7b66c1d6b4d489b9b31fa9e36264662, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,320 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/44f2e7e9e0654d29a3c14d572d16901a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,320 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.tmp/f2/bd673a26c227467bac7fa12124cc3eaf as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/bd673a26c227467bac7fa12124cc3eaf 2023-02-09 05:02:54,321 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/35a196a4032f419a9ef121f6eb14ecc8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:02:54,321 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3c8a28249336cf36d8d8434d419a7e21 in 185ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,321 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c8a28249336cf36d8d8434d419a7e21: 2023-02-09 05:02:54,321 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:54,322 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:54,322 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. started... 2023-02-09 05:02:54,322 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c62132e4ef9cf0a5a152457d6bd78c2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:02:54,322 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4fdbdca6810c01b7e476eac809009ee2 in 187ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,323 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:02:54,323 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4fdbdca6810c01b7e476eac809009ee2: 2023-02-09 05:02:54,324 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:54,324 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:54,324 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:02:54,324 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. started... 2023-02-09 05:02:54,325 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ac06087e1294746d47ae0d44332da21d: 2023-02-09 05:02:54,325 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:54,325 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:02:54,326 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/74c9196bf7ed4905a818232035fd62c9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,327 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7e4c7dfa24f86a1ec65cb15c2ade8c45 in 193ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:54,327 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. started... 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f147cd0f1c2f15b7b26f0bbf3e6db224: 2023-02-09 05:02:54,327 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:54,327 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:02:54,329 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f1/9de80cbbea6c4eb1949beb5b876fdf6a 2023-02-09 05:02:54,329 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/bd673a26c227467bac7fa12124cc3eaf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,330 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 17b027fca1c2f0776917ce61b08ff155 in 196ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,331 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 17b027fca1c2f0776917ce61b08ff155: 2023-02-09 05:02:54,331 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:54,331 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:02:54,341 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f1/9f555e85e1944c5bbd290f8cd15ca344 2023-02-09 05:02:54,356 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f2/fecda8b8fa0344d88190d6d9dc606427 2023-02-09 05:02:54,364 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f1/9de80cbbea6c4eb1949beb5b876fdf6a as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/9de80cbbea6c4eb1949beb5b876fdf6a 2023-02-09 05:02:54,371 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f2/6d3f14f701844700bd2e030a472a9d08 2023-02-09 05:02:54,372 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/9de80cbbea6c4eb1949beb5b876fdf6a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,373 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/.tmp/f2/fecda8b8fa0344d88190d6d9dc606427 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/fecda8b8fa0344d88190d6d9dc606427 2023-02-09 05:02:54,381 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/fecda8b8fa0344d88190d6d9dc606427, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,382 INFO [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2e5bfd3c3aa7141f6cecac5be2d64401 in 83ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,382 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2e5bfd3c3aa7141f6cecac5be2d64401: 2023-02-09 05:02:54,382 DEBUG [rs(jenkins-hbase4.apache.org,40155,1675918965052)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:02:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:02:54,382 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,383 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:02:54,383 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40155,1675918965052' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:02:54,385 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f1/9f555e85e1944c5bbd290f8cd15ca344 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/9f555e85e1944c5bbd290f8cd15ca344 2023-02-09 05:02:54,385 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:54,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40155,1675918965052' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 05:02:54,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a167caa[Count = 1] remaining members to acquire global barrier 2023-02-09 05:02:54,391 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/9f555e85e1944c5bbd290f8cd15ca344, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,392 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/.tmp/f2/6d3f14f701844700bd2e030a472a9d08 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/6d3f14f701844700bd2e030a472a9d08 2023-02-09 05:02:54,398 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/6d3f14f701844700bd2e030a472a9d08, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,400 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9c62132e4ef9cf0a5a152457d6bd78c2 in 78ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,400 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c62132e4ef9cf0a5a152457d6bd78c2: 2023-02-09 05:02:54,400 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:54,400 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:02:54,587 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f1/19a62367999049c8ab45d7debbe8b240 2023-02-09 05:02:54,602 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f2/feae69e4c4d54e099f3b4c4f8c1fe44b 2023-02-09 05:02:54,609 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f1/19a62367999049c8ab45d7debbe8b240 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/19a62367999049c8ab45d7debbe8b240 2023-02-09 05:02:54,615 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/19a62367999049c8ab45d7debbe8b240, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,616 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/.tmp/f2/feae69e4c4d54e099f3b4c4f8c1fe44b as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/feae69e4c4d54e099f3b4c4f8c1fe44b 2023-02-09 05:02:54,622 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/feae69e4c4d54e099f3b4c4f8c1fe44b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:02:54,623 INFO [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0d53b6188118f1d68a68407cd3cef2d2 in 488ms, sequenceid=9, compaction requested=false 2023-02-09 05:02:54,624 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0d53b6188118f1d68a68407cd3cef2d2: 2023-02-09 05:02:54,624 DEBUG [rs(jenkins-hbase4.apache.org,34441,1675918964998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:02:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:02:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:02:54,624 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34441,1675918964998' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:02:54,626 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:02:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,626 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:02:54,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:54,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34441,1675918964998' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 05:02:54,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a167caa[Count = 0] remaining members to acquire global barrier 2023-02-09 05:02:54,628 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 05:02:54,629 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,633 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,633 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:02:54,634 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40155,1675918965052' in zk 2023-02-09 05:02:54,634 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34441,1675918964998' in zk 2023-02-09 05:02:54,635 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,635 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:02:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:02:54,637 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:02:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,40155,1675918965052' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:02:54,638 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,638 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:02:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:54,638 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:54,638 DEBUG [member: 'jenkins-hbase4.apache.org,34441,1675918964998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:02:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,40155,1675918965052': 2023-02-09 05:02:54,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40155,1675918965052' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 05:02:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:02:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34441,1675918964998': 2023-02-09 05:02:54,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34441,1675918964998' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 05:02:54,649 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 05:02:54,649 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:02:54,649 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:02:54,649 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 05:02:54,649 INFO [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:02:54,652 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,652 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:02:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:02:54,652 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:02:54,652 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,652 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:02:54,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:02:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:02:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:02:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:54,654 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,654 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:02:54,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,657 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:02:54,657 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:02:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,663 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,663 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,663 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:02:54,663 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:02:54,664 DEBUG [(jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:02:54,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 05:02:54,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:02:54,663 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:02:54,664 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:02:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:54,664 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:02:54,664 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:54,665 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,665 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:54,665 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:02:54,665 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:02:54,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:02:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:02:54,664 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:02:54,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:02:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:54,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:02:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:02:54,666 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 05:02:54,666 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:02:54,766 DEBUG [Listener at localhost/40479] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:02:54,767 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:54,767 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:54,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:02:54,888 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop-1211646426082740197.jar 2023-02-09 05:02:54,907 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675918971628 type: FLUSH version: 2 ttl: 0 2023-02-09 05:02:54,908 DEBUG [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce 2023-02-09 05:02:54,909 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:54,909 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:54,909 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(239): region to add: ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=17b027fca1c2f0776917ce61b08ff155 as 17b027fca1c2f0776917ce61b08ff155 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=7e4c7dfa24f86a1ec65cb15c2ade8c45 as 7e4c7dfa24f86a1ec65cb15c2ade8c45 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,910 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=4fdbdca6810c01b7e476eac809009ee2 as 4fdbdca6810c01b7e476eac809009ee2 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=0d53b6188118f1d68a68407cd3cef2d2 as 0d53b6188118f1d68a68407cd3cef2d2 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=9c62132e4ef9cf0a5a152457d6bd78c2 as 9c62132e4ef9cf0a5a152457d6bd78c2 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=3c8a28249336cf36d8d8434d419a7e21 as 3c8a28249336cf36d8d8434d419a7e21 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=1e87ed8f5222fbc0a0693ff6e4643f3c as 1e87ed8f5222fbc0a0693ff6e4643f3c in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=2e5bfd3c3aa7141f6cecac5be2d64401 as 2e5bfd3c3aa7141f6cecac5be2d64401 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=f147cd0f1c2f15b7b26f0bbf3e6db224 as f147cd0f1c2f15b7b26f0bbf3e6db224 in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,911 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(585): clone region=ac06087e1294746d47ae0d44332da21d as ac06087e1294746d47ae0d44332da21d in snapshot testWithMapReduceMultiRegion 2023-02-09 05:02:54,915 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 17b027fca1c2f0776917ce61b08ff155, NAME => 'testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,915 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 0d53b6188118f1d68a68407cd3cef2d2, NAME => 'testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,915 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4fdbdca6810c01b7e476eac809009ee2, NAME => 'testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,915 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 9c62132e4ef9cf0a5a152457d6bd78c2, NAME => 'testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,915 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7e4c7dfa24f86a1ec65cb15c2ade8c45, NAME => 'testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,916 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1e87ed8f5222fbc0a0693ff6e4643f3c, NAME => 'testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,916 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 2e5bfd3c3aa7141f6cecac5be2d64401, NAME => 'testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,916 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3c8a28249336cf36d8d8434d419a7e21, NAME => 'testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:54,963 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:54,964 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:54,964 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:54,964 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f396241a35bc47a285e0c708024148ca from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:54,964 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 28b6923310f04667b791122b1e41bb04 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:54,964 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 54643437399849afb46179bbfeca8e68 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:54,988 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:54,988 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60b183d364b943209c619afbff5491c3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,004 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5eff2462c3734eb7ba850bb771dc3820 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,013 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 67741e04ea3444f695c4f51ed1180588 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,015 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d10e66d7856746599ad554995c4a7888 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,016 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02081774c7274f129b8e197e2b0a8637 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,019 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3c8a28249336cf36d8d8434d419a7e21, disabling compactions & flushes 2023-02-09 05:02:55,019 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:55,019 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:55,019 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. after waiting 0 ms 2023-02-09 05:02:55,019 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:55,019 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:55,019 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3c8a28249336cf36d8d8434d419a7e21: Waiting for close lock at 1675918975019Disabling compacts and flushes for region at 1675918975019Disabling writes for close at 1675918975019Writing region close event to WAL at 1675918975019Closed at 1675918975019 2023-02-09 05:02:55,020 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => f147cd0f1c2f15b7b26f0bbf3e6db224, NAME => 'testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:55,021 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 9c62132e4ef9cf0a5a152457d6bd78c2, disabling compactions & flushes 2023-02-09 05:02:55,021 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:55,021 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:55,021 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. after waiting 0 ms 2023-02-09 05:02:55,021 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:55,021 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:55,021 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Waiting for close lock at 1675918975021Disabling compacts and flushes for region at 1675918975021Disabling writes for close at 1675918975021Writing region close event to WAL at 1675918975021Closed at 1675918975021 2023-02-09 05:02:55,022 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => ac06087e1294746d47ae0d44332da21d, NAME => 'testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:55,027 WARN [DataStreamer for file /user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-09 05:02:55,027 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1e87ed8f5222fbc0a0693ff6e4643f3c, disabling compactions & flushes 2023-02-09 05:02:55,027 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:55,027 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:55,028 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. after waiting 0 ms 2023-02-09 05:02:55,028 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:55,028 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:55,028 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Waiting for close lock at 1675918975027Disabling compacts and flushes for region at 1675918975027Disabling writes for close at 1675918975028 (+1 ms)Writing region close event to WAL at 1675918975028Closed at 1675918975028 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 0d53b6188118f1d68a68407cd3cef2d2, disabling compactions & flushes 2023-02-09 05:02:55,029 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. after waiting 0 ms 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,030 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,030 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b79951f5d5bd413081bc111373205103 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,029 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:55,030 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5599569411b9402a9fa8b222027a59b2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,030 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46895f65ac034981aeb07f5f185d6971 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,030 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:55,030 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 0d53b6188118f1d68a68407cd3cef2d2: Waiting for close lock at 1675918975029Disabling compacts and flushes for region at 1675918975029Disabling writes for close at 1675918975029Writing region close event to WAL at 1675918975030 (+1 ms)Closed at 1675918975030 2023-02-09 05:02:55,044 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 283c0bcb328941f7addbff6a3e098a14 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,044 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 496ae18f452d4e3e9669b37f30a5e362 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,045 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fe4893f5fb664de8ab700b6ef5d4b97d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 17b027fca1c2f0776917ce61b08ff155, disabling compactions & flushes 2023-02-09 05:02:55,052 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. after waiting 0 ms 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:55,052 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 17b027fca1c2f0776917ce61b08ff155: Waiting for close lock at 1675918975052Disabling compacts and flushes for region at 1675918975052Disabling writes for close at 1675918975052Writing region close event to WAL at 1675918975052Closed at 1675918975052 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 7e4c7dfa24f86a1ec65cb15c2ade8c45, disabling compactions & flushes 2023-02-09 05:02:55,052 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing f147cd0f1c2f15b7b26f0bbf3e6db224, disabling compactions & flushes 2023-02-09 05:02:55,053 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:55,053 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. after waiting 0 ms 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. after waiting 0 ms 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:55,053 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:55,053 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Waiting for close lock at 1675918975052Disabling compacts and flushes for region at 1675918975052Disabling writes for close at 1675918975053 (+1 ms)Writing region close event to WAL at 1675918975053Closed at 1675918975053 2023-02-09 05:02:55,053 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Waiting for close lock at 1675918975052Disabling compacts and flushes for region at 1675918975052Disabling writes for close at 1675918975053 (+1 ms)Writing region close event to WAL at 1675918975053Closed at 1675918975053 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing ac06087e1294746d47ae0d44332da21d, disabling compactions & flushes 2023-02-09 05:02:55,055 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. after waiting 0 ms 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:55,055 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:55,055 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for ac06087e1294746d47ae0d44332da21d: Waiting for close lock at 1675918975055Disabling compacts and flushes for region at 1675918975055Disabling writes for close at 1675918975055Writing region close event to WAL at 1675918975055Closed at 1675918975055 2023-02-09 05:02:55,060 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4fdbdca6810c01b7e476eac809009ee2, disabling compactions & flushes 2023-02-09 05:02:55,061 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:55,061 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:55,061 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. after waiting 0 ms 2023-02-09 05:02:55,061 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:55,061 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:55,061 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4fdbdca6810c01b7e476eac809009ee2: Waiting for close lock at 1675918975060Disabling compacts and flushes for region at 1675918975060Disabling writes for close at 1675918975061 (+1 ms)Writing region close event to WAL at 1675918975061Closed at 1675918975061 2023-02-09 05:02:55,410 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:55,410 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2f3f533f8e14dfb95dda0ba1a6dc19f from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,413 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 79cd5c631bdd44f99048f031213898f3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-09 05:02:55,416 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 2e5bfd3c3aa7141f6cecac5be2d64401, disabling compactions & flushes 2023-02-09 05:02:55,416 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:55,416 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:55,416 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. after waiting 0 ms 2023-02-09 05:02:55,416 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:55,416 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:55,416 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Waiting for close lock at 1675918975416Disabling compacts and flushes for region at 1675918975416Disabling writes for close at 1675918975416Writing region close event to WAL at 1675918975416Closed at 1675918975416 2023-02-09 05:02:55,417 INFO [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675918971628 type: FLUSH version: 2 ttl: 0 2023-02-09 05:02:55,417 DEBUG [Listener at localhost/40479] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:55,417 DEBUG [Listener at localhost/40479] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce 2023-02-09 05:02:55,418 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-data/ 2023-02-09 05:02:55,418 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----default/ 2023-02-09 05:02:55,419 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 05:02:55,420 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------0d53b6188118f1d68a68407cd3cef2d2/ 2023-02-09 05:02:55,420 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,420 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,421 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=0d53b6188118f1d68a68407cd3cef2d2-54643437399849afb46179bbfeca8e68 2023-02-09 05:02:55,421 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,422 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=0d53b6188118f1d68a68407cd3cef2d2-02081774c7274f129b8e197e2b0a8637 2023-02-09 05:02:55,422 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------17b027fca1c2f0776917ce61b08ff155/ 2023-02-09 05:02:55,422 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,422 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,423 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=17b027fca1c2f0776917ce61b08ff155-b79951f5d5bd413081bc111373205103 2023-02-09 05:02:55,423 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,423 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=17b027fca1c2f0776917ce61b08ff155-283c0bcb328941f7addbff6a3e098a14 2023-02-09 05:02:55,424 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------1e87ed8f5222fbc0a0693ff6e4643f3c/ 2023-02-09 05:02:55,424 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,424 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,425 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=1e87ed8f5222fbc0a0693ff6e4643f3c-60b183d364b943209c619afbff5491c3 2023-02-09 05:02:55,425 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,425 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=1e87ed8f5222fbc0a0693ff6e4643f3c-d10e66d7856746599ad554995c4a7888 2023-02-09 05:02:55,426 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------2e5bfd3c3aa7141f6cecac5be2d64401/ 2023-02-09 05:02:55,426 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,426 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,427 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=2e5bfd3c3aa7141f6cecac5be2d64401-d2f3f533f8e14dfb95dda0ba1a6dc19f 2023-02-09 05:02:55,427 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,427 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=2e5bfd3c3aa7141f6cecac5be2d64401-79cd5c631bdd44f99048f031213898f3 2023-02-09 05:02:55,427 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------3c8a28249336cf36d8d8434d419a7e21/ 2023-02-09 05:02:55,428 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,428 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,429 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=3c8a28249336cf36d8d8434d419a7e21-f396241a35bc47a285e0c708024148ca 2023-02-09 05:02:55,429 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,429 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=3c8a28249336cf36d8d8434d419a7e21-67741e04ea3444f695c4f51ed1180588 2023-02-09 05:02:55,429 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------4fdbdca6810c01b7e476eac809009ee2/ 2023-02-09 05:02:55,430 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,430 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,431 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=4fdbdca6810c01b7e476eac809009ee2-5599569411b9402a9fa8b222027a59b2 2023-02-09 05:02:55,431 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,431 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=4fdbdca6810c01b7e476eac809009ee2-496ae18f452d4e3e9669b37f30a5e362 2023-02-09 05:02:55,431 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------7e4c7dfa24f86a1ec65cb15c2ade8c45/ 2023-02-09 05:02:55,432 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,432 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,433 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=7e4c7dfa24f86a1ec65cb15c2ade8c45-46895f65ac034981aeb07f5f185d6971 2023-02-09 05:02:55,433 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,433 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=7e4c7dfa24f86a1ec65cb15c2ade8c45-fe4893f5fb664de8ab700b6ef5d4b97d 2023-02-09 05:02:55,433 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------9c62132e4ef9cf0a5a152457d6bd78c2/ 2023-02-09 05:02:55,434 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,434 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:02:55,435 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=9c62132e4ef9cf0a5a152457d6bd78c2-28b6923310f04667b791122b1e41bb04 2023-02-09 05:02:55,435 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:02:55,435 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |----------------testWithMapReduce=9c62132e4ef9cf0a5a152457d6bd78c2-5eff2462c3734eb7ba850bb771dc3820 2023-02-09 05:02:55,436 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------ac06087e1294746d47ae0d44332da21d/ 2023-02-09 05:02:55,436 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,436 DEBUG [Listener at localhost/40479] util.CommonFSUtils(699): |----------f147cd0f1c2f15b7b26f0bbf3e6db224/ 2023-02-09 05:02:55,437 DEBUG [Listener at localhost/40479] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:02:55,446 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:55,446 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:55,447 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:55,447 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,421 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop-3090670289666902151.jar 2023-02-09 05:02:56,422 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,422 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,490 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop-6618252083617286488.jar 2023-02-09 05:02:56,491 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,491 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,492 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,493 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,493 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,493 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,494 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 05:02:56,494 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 05:02:56,495 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 05:02:56,495 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 05:02:56,496 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 05:02:56,496 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 05:02:56,497 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 05:02:56,497 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 05:02:56,498 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 05:02:56,498 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 05:02:56,505 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:02:56,505 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:02:56,506 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:02:56,506 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:02:56,507 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:02:56,575 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop-4876144291443443477.jar 2023-02-09 05:02:56,576 DEBUG [Listener at localhost/40479] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:02:56,629 WARN [Listener at localhost/40479] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 05:02:56,640 WARN [Listener at localhost/40479] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 05:02:56,652 INFO [Listener at localhost/40479] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 05:02:57,085 WARN [Listener at localhost/40479] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/mapreduce.cluster.local.dir/1675918976949/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 05:02:57,085 WARN [Listener at localhost/40479] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/mapreduce.cluster.local.dir/1675918976949/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 05:02:57,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,268 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,270 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,273 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:57,274 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1 2023-02-09 05:02:57,274 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d53b6188118f1d68a68407cd3cef2d2 columnFamilyName f1 2023-02-09 05:02:57,283 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/testWithMapReduce=0d53b6188118f1d68a68407cd3cef2d2-54643437399849afb46179bbfeca8e68 2023-02-09 05:02:57,284 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(310): Store=0d53b6188118f1d68a68407cd3cef2d2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,284 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:57,285 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2 2023-02-09 05:02:57,286 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d53b6188118f1d68a68407cd3cef2d2 columnFamilyName f2 2023-02-09 05:02:57,292 DEBUG [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/testWithMapReduce=0d53b6188118f1d68a68407cd3cef2d2-02081774c7274f129b8e197e2b0a8637 2023-02-09 05:02:57,292 INFO [StoreOpener-0d53b6188118f1d68a68407cd3cef2d2-1] regionserver.HStore(310): Store=0d53b6188118f1d68a68407cd3cef2d2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,292 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0d53b6188118f1d68a68407cd3cef2d2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72106224, jitterRate=0.07446646690368652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,292 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0d53b6188118f1d68a68407cd3cef2d2: Writing region info on filesystem at 1675918977270Initializing all the Stores at 1675918977271 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977271Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977272 (+1 ms)Region opened successfully at 1675918977292 (+20 ms) 2023-02-09 05:02:57,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0d53b6188118f1d68a68407cd3cef2d2, disabling compactions & flushes 2023-02-09 05:02:57,453 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:57,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:57,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. after waiting 0 ms 2023-02-09 05:02:57,453 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:57,460 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:57,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0d53b6188118f1d68a68407cd3cef2d2: Waiting for close lock at 1675918977453Disabling compacts and flushes for region at 1675918977453Disabling writes for close at 1675918977453Writing region close event to WAL at 1675918977460 (+7 ms)Closed at 1675918977460 2023-02-09 05:02:57,478 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,478 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,480 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,482 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:57,483 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1 2023-02-09 05:02:57,484 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e5bfd3c3aa7141f6cecac5be2d64401 columnFamilyName f1 2023-02-09 05:02:57,494 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/testWithMapReduce=2e5bfd3c3aa7141f6cecac5be2d64401-d2f3f533f8e14dfb95dda0ba1a6dc19f 2023-02-09 05:02:57,495 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(310): Store=2e5bfd3c3aa7141f6cecac5be2d64401/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,495 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:57,496 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2 2023-02-09 05:02:57,497 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e5bfd3c3aa7141f6cecac5be2d64401 columnFamilyName f2 2023-02-09 05:02:57,503 DEBUG [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/testWithMapReduce=2e5bfd3c3aa7141f6cecac5be2d64401-79cd5c631bdd44f99048f031213898f3 2023-02-09 05:02:57,503 INFO [StoreOpener-2e5bfd3c3aa7141f6cecac5be2d64401-1] regionserver.HStore(310): Store=2e5bfd3c3aa7141f6cecac5be2d64401/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,503 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,504 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2e5bfd3c3aa7141f6cecac5be2d64401; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69418256, jitterRate=0.03441262245178223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,504 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Writing region info on filesystem at 1675918977480Initializing all the Stores at 1675918977481 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977481Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977481Region opened successfully at 1675918977504 (+23 ms) 2023-02-09 05:02:57,557 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2e5bfd3c3aa7141f6cecac5be2d64401, disabling compactions & flushes 2023-02-09 05:02:57,558 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:57,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:57,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. after waiting 0 ms 2023-02-09 05:02:57,558 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:57,561 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:57,561 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Waiting for close lock at 1675918977557Disabling compacts and flushes for region at 1675918977557Disabling writes for close at 1675918977558 (+1 ms)Writing region close event to WAL at 1675918977561 (+3 ms)Closed at 1675918977561 2023-02-09 05:02:57,566 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,567 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,568 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,570 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:57,571 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1 2023-02-09 05:02:57,572 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e87ed8f5222fbc0a0693ff6e4643f3c columnFamilyName f1 2023-02-09 05:02:57,579 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/testWithMapReduce=1e87ed8f5222fbc0a0693ff6e4643f3c-60b183d364b943209c619afbff5491c3 2023-02-09 05:02:57,579 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(310): Store=1e87ed8f5222fbc0a0693ff6e4643f3c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,579 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:57,580 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2 2023-02-09 05:02:57,581 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e87ed8f5222fbc0a0693ff6e4643f3c columnFamilyName f2 2023-02-09 05:02:57,591 DEBUG [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/testWithMapReduce=1e87ed8f5222fbc0a0693ff6e4643f3c-d10e66d7856746599ad554995c4a7888 2023-02-09 05:02:57,591 INFO [StoreOpener-1e87ed8f5222fbc0a0693ff6e4643f3c-1] regionserver.HStore(310): Store=1e87ed8f5222fbc0a0693ff6e4643f3c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,592 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1e87ed8f5222fbc0a0693ff6e4643f3c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61914072, jitterRate=-0.07740843296051025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Writing region info on filesystem at 1675918977568Initializing all the Stores at 1675918977569 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977569Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977569Region opened successfully at 1675918977592 (+23 ms) 2023-02-09 05:02:57,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1e87ed8f5222fbc0a0693ff6e4643f3c, disabling compactions & flushes 2023-02-09 05:02:57,662 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:57,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:57,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. after waiting 0 ms 2023-02-09 05:02:57,662 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:57,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:57,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Waiting for close lock at 1675918977662Disabling compacts and flushes for region at 1675918977662Disabling writes for close at 1675918977662Writing region close event to WAL at 1675918977666 (+4 ms)Closed at 1675918977666 2023-02-09 05:02:57,671 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,672 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,677 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,681 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:57,682 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1 2023-02-09 05:02:57,683 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b027fca1c2f0776917ce61b08ff155 columnFamilyName f1 2023-02-09 05:02:57,693 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/testWithMapReduce=17b027fca1c2f0776917ce61b08ff155-b79951f5d5bd413081bc111373205103 2023-02-09 05:02:57,693 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(310): Store=17b027fca1c2f0776917ce61b08ff155/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,693 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:57,694 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2 2023-02-09 05:02:57,695 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17b027fca1c2f0776917ce61b08ff155 columnFamilyName f2 2023-02-09 05:02:57,706 DEBUG [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/testWithMapReduce=17b027fca1c2f0776917ce61b08ff155-283c0bcb328941f7addbff6a3e098a14 2023-02-09 05:02:57,706 INFO [StoreOpener-17b027fca1c2f0776917ce61b08ff155-1] regionserver.HStore(310): Store=17b027fca1c2f0776917ce61b08ff155/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,706 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 17b027fca1c2f0776917ce61b08ff155; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66499251, jitterRate=-0.009083941578865051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,706 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 17b027fca1c2f0776917ce61b08ff155: Writing region info on filesystem at 1675918977677Initializing all the Stores at 1675918977678 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977678Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977680 (+2 ms)Region opened successfully at 1675918977706 (+26 ms) 2023-02-09 05:02:57,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 17b027fca1c2f0776917ce61b08ff155, disabling compactions & flushes 2023-02-09 05:02:57,751 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:57,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:57,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. after waiting 0 ms 2023-02-09 05:02:57,751 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:57,754 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:57,754 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 17b027fca1c2f0776917ce61b08ff155: Waiting for close lock at 1675918977751Disabling compacts and flushes for region at 1675918977751Disabling writes for close at 1675918977751Writing region close event to WAL at 1675918977754 (+3 ms)Closed at 1675918977754 2023-02-09 05:02:57,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,761 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,762 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,767 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:57,769 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f1 2023-02-09 05:02:57,770 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f147cd0f1c2f15b7b26f0bbf3e6db224 columnFamilyName f1 2023-02-09 05:02:57,771 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(310): Store=f147cd0f1c2f15b7b26f0bbf3e6db224/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,771 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:57,773 DEBUG [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f2 2023-02-09 05:02:57,774 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f147cd0f1c2f15b7b26f0bbf3e6db224 columnFamilyName f2 2023-02-09 05:02:57,775 INFO [StoreOpener-f147cd0f1c2f15b7b26f0bbf3e6db224-1] regionserver.HStore(310): Store=f147cd0f1c2f15b7b26f0bbf3e6db224/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,776 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f147cd0f1c2f15b7b26f0bbf3e6db224; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73819084, jitterRate=0.09999006986618042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,776 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Writing region info on filesystem at 1675918977762Initializing all the Stores at 1675918977765 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977765Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977767 (+2 ms)Region opened successfully at 1675918977776 (+9 ms) 2023-02-09 05:02:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f147cd0f1c2f15b7b26f0bbf3e6db224, disabling compactions & flushes 2023-02-09 05:02:57,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. after waiting 0 ms 2023-02-09 05:02:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:57,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:57,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Waiting for close lock at 1675918977816Disabling compacts and flushes for region at 1675918977816Disabling writes for close at 1675918977816Writing region close event to WAL at 1675918977816Closed at 1675918977816 2023-02-09 05:02:57,821 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,821 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,822 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,824 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:57,845 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f1 2023-02-09 05:02:57,845 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac06087e1294746d47ae0d44332da21d columnFamilyName f1 2023-02-09 05:02:57,846 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(310): Store=ac06087e1294746d47ae0d44332da21d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,847 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:57,851 DEBUG [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f2 2023-02-09 05:02:57,851 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac06087e1294746d47ae0d44332da21d columnFamilyName f2 2023-02-09 05:02:57,852 INFO [StoreOpener-ac06087e1294746d47ae0d44332da21d-1] regionserver.HStore(310): Store=ac06087e1294746d47ae0d44332da21d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,852 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,852 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ac06087e1294746d47ae0d44332da21d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72870017, jitterRate=0.085847869515419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,853 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ac06087e1294746d47ae0d44332da21d: Writing region info on filesystem at 1675918977822Initializing all the Stores at 1675918977823 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977823Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977824 (+1 ms)Region opened successfully at 1675918977853 (+29 ms) 2023-02-09 05:02:57,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ac06087e1294746d47ae0d44332da21d, disabling compactions & flushes 2023-02-09 05:02:57,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:57,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:57,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. after waiting 0 ms 2023-02-09 05:02:57,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:57,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:57,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ac06087e1294746d47ae0d44332da21d: Waiting for close lock at 1675918977869Disabling compacts and flushes for region at 1675918977869Disabling writes for close at 1675918977870 (+1 ms)Writing region close event to WAL at 1675918977870Closed at 1675918977870 2023-02-09 05:02:57,874 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,874 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,875 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,878 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:57,879 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1 2023-02-09 05:02:57,879 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c62132e4ef9cf0a5a152457d6bd78c2 columnFamilyName f1 2023-02-09 05:02:57,885 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/testWithMapReduce=9c62132e4ef9cf0a5a152457d6bd78c2-28b6923310f04667b791122b1e41bb04 2023-02-09 05:02:57,885 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(310): Store=9c62132e4ef9cf0a5a152457d6bd78c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,885 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:57,886 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2 2023-02-09 05:02:57,886 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c62132e4ef9cf0a5a152457d6bd78c2 columnFamilyName f2 2023-02-09 05:02:57,892 DEBUG [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/testWithMapReduce=9c62132e4ef9cf0a5a152457d6bd78c2-5eff2462c3734eb7ba850bb771dc3820 2023-02-09 05:02:57,892 INFO [StoreOpener-9c62132e4ef9cf0a5a152457d6bd78c2-1] regionserver.HStore(310): Store=9c62132e4ef9cf0a5a152457d6bd78c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,892 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9c62132e4ef9cf0a5a152457d6bd78c2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59441118, jitterRate=-0.11425831913948059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,892 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Writing region info on filesystem at 1675918977875Initializing all the Stores at 1675918977876 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977876Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977877 (+1 ms)Region opened successfully at 1675918977892 (+15 ms) 2023-02-09 05:02:57,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9c62132e4ef9cf0a5a152457d6bd78c2, disabling compactions & flushes 2023-02-09 05:02:57,924 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:57,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:57,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. after waiting 0 ms 2023-02-09 05:02:57,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:57,927 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:57,928 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Waiting for close lock at 1675918977924Disabling compacts and flushes for region at 1675918977924Disabling writes for close at 1675918977924Writing region close event to WAL at 1675918977927 (+3 ms)Closed at 1675918977927 2023-02-09 05:02:57,932 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:57,932 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:57,937 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:57,939 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:57,940 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1 2023-02-09 05:02:57,940 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e4c7dfa24f86a1ec65cb15c2ade8c45 columnFamilyName f1 2023-02-09 05:02:57,956 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/testWithMapReduce=7e4c7dfa24f86a1ec65cb15c2ade8c45-46895f65ac034981aeb07f5f185d6971 2023-02-09 05:02:57,956 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(310): Store=7e4c7dfa24f86a1ec65cb15c2ade8c45/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,956 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:57,957 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2 2023-02-09 05:02:57,958 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e4c7dfa24f86a1ec65cb15c2ade8c45 columnFamilyName f2 2023-02-09 05:02:57,966 DEBUG [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/testWithMapReduce=7e4c7dfa24f86a1ec65cb15c2ade8c45-fe4893f5fb664de8ab700b6ef5d4b97d 2023-02-09 05:02:57,966 INFO [StoreOpener-7e4c7dfa24f86a1ec65cb15c2ade8c45-1] regionserver.HStore(310): Store=7e4c7dfa24f86a1ec65cb15c2ade8c45/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:57,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:57,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7e4c7dfa24f86a1ec65cb15c2ade8c45; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74016975, jitterRate=0.10293887555599213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:57,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Writing region info on filesystem at 1675918977937Initializing all the Stores at 1675918977938 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977938Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918977938Region opened successfully at 1675918977967 (+29 ms) 2023-02-09 05:02:57,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7e4c7dfa24f86a1ec65cb15c2ade8c45, disabling compactions & flushes 2023-02-09 05:02:57,999 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:57,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:57,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. after waiting 0 ms 2023-02-09 05:02:57,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:58,002 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:58,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Waiting for close lock at 1675918977999Disabling compacts and flushes for region at 1675918977999Disabling writes for close at 1675918977999Writing region close event to WAL at 1675918978002 (+3 ms)Closed at 1675918978002 2023-02-09 05:02:58,006 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:58,006 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:58,007 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:58,009 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:58,010 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1 2023-02-09 05:02:58,011 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdbdca6810c01b7e476eac809009ee2 columnFamilyName f1 2023-02-09 05:02:58,022 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/testWithMapReduce=4fdbdca6810c01b7e476eac809009ee2-5599569411b9402a9fa8b222027a59b2 2023-02-09 05:02:58,022 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(310): Store=4fdbdca6810c01b7e476eac809009ee2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:58,022 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:58,023 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2 2023-02-09 05:02:58,024 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fdbdca6810c01b7e476eac809009ee2 columnFamilyName f2 2023-02-09 05:02:58,030 DEBUG [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/testWithMapReduce=4fdbdca6810c01b7e476eac809009ee2-496ae18f452d4e3e9669b37f30a5e362 2023-02-09 05:02:58,030 INFO [StoreOpener-4fdbdca6810c01b7e476eac809009ee2-1] regionserver.HStore(310): Store=4fdbdca6810c01b7e476eac809009ee2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:58,030 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:58,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4fdbdca6810c01b7e476eac809009ee2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67970675, jitterRate=0.012841984629631042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:58,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4fdbdca6810c01b7e476eac809009ee2: Writing region info on filesystem at 1675918978007Initializing all the Stores at 1675918978008 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918978008Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918978008Region opened successfully at 1675918978031 (+23 ms) 2023-02-09 05:02:58,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4fdbdca6810c01b7e476eac809009ee2, disabling compactions & flushes 2023-02-09 05:02:58,072 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:58,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:58,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. after waiting 0 ms 2023-02-09 05:02:58,072 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:58,075 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:58,075 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4fdbdca6810c01b7e476eac809009ee2: Waiting for close lock at 1675918978072Disabling compacts and flushes for region at 1675918978072Disabling writes for close at 1675918978072Writing region close event to WAL at 1675918978075 (+3 ms)Closed at 1675918978075 2023-02-09 05:02:58,079 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:02:58,079 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:02:58,080 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:02:58,081 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:58,082 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1 2023-02-09 05:02:58,083 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8a28249336cf36d8d8434d419a7e21 columnFamilyName f1 2023-02-09 05:02:58,090 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/testWithMapReduce=3c8a28249336cf36d8d8434d419a7e21-f396241a35bc47a285e0c708024148ca 2023-02-09 05:02:58,090 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(310): Store=3c8a28249336cf36d8d8434d419a7e21/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:58,090 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:58,091 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2 2023-02-09 05:02:58,091 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c8a28249336cf36d8d8434d419a7e21 columnFamilyName f2 2023-02-09 05:02:58,097 DEBUG [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(539): loaded hdfs://localhost:38613/user/jenkins/test-data/9412b666-627a-1303-623f-f00912e25bf5/testWithMapReduceMultiRegion/6a98af57-e544-4633-9002-38f0e7e649ce/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/testWithMapReduce=3c8a28249336cf36d8d8434d419a7e21-67741e04ea3444f695c4f51ed1180588 2023-02-09 05:02:58,097 INFO [StoreOpener-3c8a28249336cf36d8d8434d419a7e21-1] regionserver.HStore(310): Store=3c8a28249336cf36d8d8434d419a7e21/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:02:58,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:02:58,097 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3c8a28249336cf36d8d8434d419a7e21; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61004208, jitterRate=-0.09096646308898926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:02:58,097 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3c8a28249336cf36d8d8434d419a7e21: Writing region info on filesystem at 1675918978080Initializing all the Stores at 1675918978081 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918978081Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918978081Region opened successfully at 1675918978097 (+16 ms) 2023-02-09 05:02:58,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3c8a28249336cf36d8d8434d419a7e21, disabling compactions & flushes 2023-02-09 05:02:58,140 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:58,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:58,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. after waiting 0 ms 2023-02-09 05:02:58,140 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:58,143 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:58,143 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3c8a28249336cf36d8d8434d419a7e21: Waiting for close lock at 1675918978140Disabling compacts and flushes for region at 1675918978140Disabling writes for close at 1675918978140Writing region close event to WAL at 1675918978143 (+3 ms)Closed at 1675918978143 2023-02-09 05:02:59,176 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,177 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-09 05:02:59,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-09 05:02:59,189 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,189 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,189 INFO [Listener at localhost/40479] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 05:02:59,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 05:02:59,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918979214"}]},"ts":"1675918979214"} 2023-02-09 05:02:59,214 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,215 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:02:59,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 05:02:59,218 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 05:02:59,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, UNASSIGN}] 2023-02-09 05:02:59,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, UNASSIGN 2023-02-09 05:02:59,225 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, UNASSIGN 2023-02-09 05:02:59,225 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, UNASSIGN 2023-02-09 05:02:59,225 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, UNASSIGN 2023-02-09 05:02:59,225 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, UNASSIGN 2023-02-09 05:02:59,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2e5bfd3c3aa7141f6cecac5be2d64401, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:59,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0d53b6188118f1d68a68407cd3cef2d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:59,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979226"}]},"ts":"1675918979226"} 2023-02-09 05:02:59,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979226"}]},"ts":"1675918979226"} 2023-02-09 05:02:59,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=17b027fca1c2f0776917ce61b08ff155, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:59,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979227"}]},"ts":"1675918979227"} 2023-02-09 05:02:59,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3c8a28249336cf36d8d8434d419a7e21, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:59,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979226"}]},"ts":"1675918979226"} 2023-02-09 05:02:59,228 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ac06087e1294746d47ae0d44332da21d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:59,228 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918979227"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979227"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979227"}]},"ts":"1675918979227"} 2023-02-09 05:02:59,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=39, state=RUNNABLE; CloseRegionProcedure 2e5bfd3c3aa7141f6cecac5be2d64401, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:59,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 0d53b6188118f1d68a68407cd3cef2d2, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:59,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=38, state=RUNNABLE; CloseRegionProcedure 17b027fca1c2f0776917ce61b08ff155, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:59,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 3c8a28249336cf36d8d8434d419a7e21, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:59,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure ac06087e1294746d47ae0d44332da21d, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:59,243 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, UNASSIGN 2023-02-09 05:02:59,243 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, UNASSIGN 2023-02-09 05:02:59,243 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, UNASSIGN 2023-02-09 05:02:59,243 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, UNASSIGN 2023-02-09 05:02:59,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, UNASSIGN 2023-02-09 05:02:59,245 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4fdbdca6810c01b7e476eac809009ee2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:59,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7e4c7dfa24f86a1ec65cb15c2ade8c45, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:59,245 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1e87ed8f5222fbc0a0693ff6e4643f3c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:02:59,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979245"}]},"ts":"1675918979245"} 2023-02-09 05:02:59,245 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979245"}]},"ts":"1675918979245"} 2023-02-09 05:02:59,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c62132e4ef9cf0a5a152457d6bd78c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:59,245 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979245"}]},"ts":"1675918979245"} 2023-02-09 05:02:59,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979245"}]},"ts":"1675918979245"} 2023-02-09 05:02:59,246 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f147cd0f1c2f15b7b26f0bbf3e6db224, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:02:59,246 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918979246"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918979246"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918979246"}]},"ts":"1675918979246"} 2023-02-09 05:02:59,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=37, state=RUNNABLE; CloseRegionProcedure 7e4c7dfa24f86a1ec65cb15c2ade8c45, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:59,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=35, state=RUNNABLE; CloseRegionProcedure 1e87ed8f5222fbc0a0693ff6e4643f3c, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:59,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=42, state=RUNNABLE; CloseRegionProcedure 4fdbdca6810c01b7e476eac809009ee2, server=jenkins-hbase4.apache.org,40155,1675918965052}] 2023-02-09 05:02:59,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=36, state=RUNNABLE; CloseRegionProcedure 9c62132e4ef9cf0a5a152457d6bd78c2, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:59,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure f147cd0f1c2f15b7b26f0bbf3e6db224, server=jenkins-hbase4.apache.org,34441,1675918964998}] 2023-02-09 05:02:59,316 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,316 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:02:59,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:59,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:59,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1e87ed8f5222fbc0a0693ff6e4643f3c, disabling compactions & flushes 2023-02-09 05:02:59,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7e4c7dfa24f86a1ec65cb15c2ade8c45, disabling compactions & flushes 2023-02-09 05:02:59,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:59,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:59,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:59,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:59,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. after waiting 0 ms 2023-02-09 05:02:59,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:59,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. after waiting 0 ms 2023-02-09 05:02:59,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c. 2023-02-09 05:02:59,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1e87ed8f5222fbc0a0693ff6e4643f3c: Waiting for close lock at 1675918979395Running coprocessor pre-close hooks at 1675918979395Disabling compacts and flushes for region at 1675918979395Disabling writes for close at 1675918979396 (+1 ms)Writing region close event to WAL at 1675918979414 (+18 ms)Running coprocessor post-close hooks at 1675918979425 (+11 ms)Closed at 1675918979426 (+1 ms) 2023-02-09 05:02:59,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45. 2023-02-09 05:02:59,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7e4c7dfa24f86a1ec65cb15c2ade8c45: Waiting for close lock at 1675918979395Running coprocessor pre-close hooks at 1675918979395Disabling compacts and flushes for region at 1675918979395Disabling writes for close at 1675918979396 (+1 ms)Writing region close event to WAL at 1675918979414 (+18 ms)Running coprocessor post-close hooks at 1675918979426 (+12 ms)Closed at 1675918979426 2023-02-09 05:02:59,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:59,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:59,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c62132e4ef9cf0a5a152457d6bd78c2, disabling compactions & flushes 2023-02-09 05:02:59,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:59,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:59,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. after waiting 0 ms 2023-02-09 05:02:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:59,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7e4c7dfa24f86a1ec65cb15c2ade8c45, regionState=CLOSED 2023-02-09 05:02:59,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979437"}]},"ts":"1675918979437"} 2023-02-09 05:02:59,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:59,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:59,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fdbdca6810c01b7e476eac809009ee2, disabling compactions & flushes 2023-02-09 05:02:59,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:59,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:59,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. after waiting 0 ms 2023-02-09 05:02:59,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:59,440 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1e87ed8f5222fbc0a0693ff6e4643f3c, regionState=CLOSED 2023-02-09 05:02:59,440 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979439"}]},"ts":"1675918979439"} 2023-02-09 05:02:59,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=37 2023-02-09 05:02:59,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=37, state=SUCCESS; CloseRegionProcedure 7e4c7dfa24f86a1ec65cb15c2ade8c45, server=jenkins-hbase4.apache.org,34441,1675918964998 in 193 msec 2023-02-09 05:02:59,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=35 2023-02-09 05:02:59,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=35, state=SUCCESS; CloseRegionProcedure 1e87ed8f5222fbc0a0693ff6e4643f3c, server=jenkins-hbase4.apache.org,40155,1675918965052 in 192 msec 2023-02-09 05:02:59,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e4c7dfa24f86a1ec65cb15c2ade8c45, UNASSIGN in 223 msec 2023-02-09 05:02:59,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1e87ed8f5222fbc0a0693ff6e4643f3c, UNASSIGN in 225 msec 2023-02-09 05:02:59,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2. 2023-02-09 05:02:59,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c62132e4ef9cf0a5a152457d6bd78c2: Waiting for close lock at 1675918979437Running coprocessor pre-close hooks at 1675918979437Disabling compacts and flushes for region at 1675918979437Disabling writes for close at 1675918979438 (+1 ms)Writing region close event to WAL at 1675918979458 (+20 ms)Running coprocessor post-close hooks at 1675918979463 (+5 ms)Closed at 1675918979469 (+6 ms) 2023-02-09 05:02:59,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2. 2023-02-09 05:02:59,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fdbdca6810c01b7e476eac809009ee2: Waiting for close lock at 1675918979439Running coprocessor pre-close hooks at 1675918979439Disabling compacts and flushes for region at 1675918979439Disabling writes for close at 1675918979439Writing region close event to WAL at 1675918979459 (+20 ms)Running coprocessor post-close hooks at 1675918979470 (+11 ms)Closed at 1675918979471 (+1 ms) 2023-02-09 05:02:59,473 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9c62132e4ef9cf0a5a152457d6bd78c2, regionState=CLOSED 2023-02-09 05:02:59,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:59,473 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979473"}]},"ts":"1675918979473"} 2023-02-09 05:02:59,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:59,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:59,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2e5bfd3c3aa7141f6cecac5be2d64401, disabling compactions & flushes 2023-02-09 05:02:59,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. after waiting 0 ms 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:59,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3c8a28249336cf36d8d8434d419a7e21, disabling compactions & flushes 2023-02-09 05:02:59,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. after waiting 0 ms 2023-02-09 05:02:59,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:59,475 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4fdbdca6810c01b7e476eac809009ee2, regionState=CLOSED 2023-02-09 05:02:59,475 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979475"}]},"ts":"1675918979475"} 2023-02-09 05:02:59,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=36 2023-02-09 05:02:59,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=36, state=SUCCESS; CloseRegionProcedure 9c62132e4ef9cf0a5a152457d6bd78c2, server=jenkins-hbase4.apache.org,34441,1675918964998 in 225 msec 2023-02-09 05:02:59,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=42 2023-02-09 05:02:59,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=42, state=SUCCESS; CloseRegionProcedure 4fdbdca6810c01b7e476eac809009ee2, server=jenkins-hbase4.apache.org,40155,1675918965052 in 227 msec 2023-02-09 05:02:59,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9c62132e4ef9cf0a5a152457d6bd78c2, UNASSIGN in 259 msec 2023-02-09 05:02:59,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4fdbdca6810c01b7e476eac809009ee2, UNASSIGN in 257 msec 2023-02-09 05:02:59,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21. 2023-02-09 05:02:59,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3c8a28249336cf36d8d8434d419a7e21: Waiting for close lock at 1675918979473Running coprocessor pre-close hooks at 1675918979473Disabling compacts and flushes for region at 1675918979473Disabling writes for close at 1675918979474 (+1 ms)Writing region close event to WAL at 1675918979490 (+16 ms)Running coprocessor post-close hooks at 1675918979495 (+5 ms)Closed at 1675918979496 (+1 ms) 2023-02-09 05:02:59,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:59,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:59,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0d53b6188118f1d68a68407cd3cef2d2, disabling compactions & flushes 2023-02-09 05:02:59,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:59,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:59,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. after waiting 0 ms 2023-02-09 05:02:59,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:59,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=3c8a28249336cf36d8d8434d419a7e21, regionState=CLOSED 2023-02-09 05:02:59,500 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979499"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979499"}]},"ts":"1675918979499"} 2023-02-09 05:02:59,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-09 05:02:59,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 3c8a28249336cf36d8d8434d419a7e21, server=jenkins-hbase4.apache.org,34441,1675918964998 in 265 msec 2023-02-09 05:02:59,506 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3c8a28249336cf36d8d8434d419a7e21, UNASSIGN in 284 msec 2023-02-09 05:02:59,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401. 2023-02-09 05:02:59,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2e5bfd3c3aa7141f6cecac5be2d64401: Waiting for close lock at 1675918979474Running coprocessor pre-close hooks at 1675918979474Disabling compacts and flushes for region at 1675918979474Disabling writes for close at 1675918979474Writing region close event to WAL at 1675918979489 (+15 ms)Running coprocessor post-close hooks at 1675918979509 (+20 ms)Closed at 1675918979517 (+8 ms) 2023-02-09 05:02:59,519 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,519 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:59,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:59,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 17b027fca1c2f0776917ce61b08ff155, disabling compactions & flushes 2023-02-09 05:02:59,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:59,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:59,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. after waiting 0 ms 2023-02-09 05:02:59,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:59,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:02:59,521 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=2e5bfd3c3aa7141f6cecac5be2d64401, regionState=CLOSED 2023-02-09 05:02:59,521 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979520"}]},"ts":"1675918979520"} 2023-02-09 05:02:59,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=39 2023-02-09 05:02:59,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=39, state=SUCCESS; CloseRegionProcedure 2e5bfd3c3aa7141f6cecac5be2d64401, server=jenkins-hbase4.apache.org,40155,1675918965052 in 291 msec 2023-02-09 05:02:59,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2e5bfd3c3aa7141f6cecac5be2d64401, UNASSIGN in 305 msec 2023-02-09 05:02:59,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:02:59,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2. 2023-02-09 05:02:59,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155. 2023-02-09 05:02:59,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0d53b6188118f1d68a68407cd3cef2d2: Waiting for close lock at 1675918979499Running coprocessor pre-close hooks at 1675918979499Disabling compacts and flushes for region at 1675918979499Disabling writes for close at 1675918979499Writing region close event to WAL at 1675918979528 (+29 ms)Running coprocessor post-close hooks at 1675918979541 (+13 ms)Closed at 1675918979542 (+1 ms) 2023-02-09 05:02:59,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 17b027fca1c2f0776917ce61b08ff155: Waiting for close lock at 1675918979519Running coprocessor pre-close hooks at 1675918979519Disabling compacts and flushes for region at 1675918979519Disabling writes for close at 1675918979520 (+1 ms)Writing region close event to WAL at 1675918979529 (+9 ms)Running coprocessor post-close hooks at 1675918979541 (+12 ms)Closed at 1675918979542 (+1 ms) 2023-02-09 05:02:59,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:59,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:59,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ac06087e1294746d47ae0d44332da21d, disabling compactions & flushes 2023-02-09 05:02:59,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:59,545 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=17b027fca1c2f0776917ce61b08ff155, regionState=CLOSED 2023-02-09 05:02:59,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:59,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. after waiting 0 ms 2023-02-09 05:02:59,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:59,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979545"}]},"ts":"1675918979545"} 2023-02-09 05:02:59,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:59,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:59,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f147cd0f1c2f15b7b26f0bbf3e6db224, disabling compactions & flushes 2023-02-09 05:02:59,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:59,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:59,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. after waiting 0 ms 2023-02-09 05:02:59,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:59,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=0d53b6188118f1d68a68407cd3cef2d2, regionState=CLOSED 2023-02-09 05:02:59,547 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918979547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979547"}]},"ts":"1675918979547"} 2023-02-09 05:02:59,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=38 2023-02-09 05:02:59,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=38, state=SUCCESS; CloseRegionProcedure 17b027fca1c2f0776917ce61b08ff155, server=jenkins-hbase4.apache.org,40155,1675918965052 in 314 msec 2023-02-09 05:02:59,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-09 05:02:59,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 0d53b6188118f1d68a68407cd3cef2d2, server=jenkins-hbase4.apache.org,34441,1675918964998 in 317 msec 2023-02-09 05:02:59,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=17b027fca1c2f0776917ce61b08ff155, UNASSIGN in 330 msec 2023-02-09 05:02:59,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0d53b6188118f1d68a68407cd3cef2d2, UNASSIGN in 332 msec 2023-02-09 05:02:59,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:02:59,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224. 2023-02-09 05:02:59,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f147cd0f1c2f15b7b26f0bbf3e6db224: Waiting for close lock at 1675918979546Running coprocessor pre-close hooks at 1675918979546Disabling compacts and flushes for region at 1675918979546Disabling writes for close at 1675918979546Writing region close event to WAL at 1675918979556 (+10 ms)Running coprocessor post-close hooks at 1675918979561 (+5 ms)Closed at 1675918979562 (+1 ms) 2023-02-09 05:02:59,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:59,566 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f147cd0f1c2f15b7b26f0bbf3e6db224, regionState=CLOSED 2023-02-09 05:02:59,566 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918979566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979566"}]},"ts":"1675918979566"} 2023-02-09 05:02:59,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:02:59,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d. 2023-02-09 05:02:59,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ac06087e1294746d47ae0d44332da21d: Waiting for close lock at 1675918979545Running coprocessor pre-close hooks at 1675918979545Disabling compacts and flushes for region at 1675918979545Disabling writes for close at 1675918979545Writing region close event to WAL at 1675918979560 (+15 ms)Running coprocessor post-close hooks at 1675918979569 (+9 ms)Closed at 1675918979570 (+1 ms) 2023-02-09 05:02:59,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-09 05:02:59,573 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure f147cd0f1c2f15b7b26f0bbf3e6db224, server=jenkins-hbase4.apache.org,34441,1675918964998 in 315 msec 2023-02-09 05:02:59,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:59,573 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ac06087e1294746d47ae0d44332da21d, regionState=CLOSED 2023-02-09 05:02:59,574 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918979573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918979573"}]},"ts":"1675918979573"} 2023-02-09 05:02:59,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f147cd0f1c2f15b7b26f0bbf3e6db224, UNASSIGN in 353 msec 2023-02-09 05:02:59,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-09 05:02:59,578 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure ac06087e1294746d47ae0d44332da21d, server=jenkins-hbase4.apache.org,40155,1675918965052 in 338 msec 2023-02-09 05:02:59,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=33 2023-02-09 05:02:59,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac06087e1294746d47ae0d44332da21d, UNASSIGN in 356 msec 2023-02-09 05:02:59,581 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918979581"}]},"ts":"1675918979581"} 2023-02-09 05:02:59,583 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 05:02:59,585 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 05:02:59,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 395 msec 2023-02-09 05:02:59,821 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,822 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:02:59,823 INFO [Listener at localhost/40479] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-09 05:02:59,824 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,824 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 05:02:59,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,838 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,840 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,840 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 05:02:59,855 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:59,855 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:59,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:59,862 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/recovered.edits] 2023-02-09 05:02:59,862 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/recovered.edits] 2023-02-09 05:02:59,862 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/recovered.edits] 2023-02-09 05:02:59,862 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/recovered.edits] 2023-02-09 05:02:59,863 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/recovered.edits] 2023-02-09 05:02:59,864 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/recovered.edits] 2023-02-09 05:02:59,864 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/recovered.edits] 2023-02-09 05:02:59,864 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/recovered.edits] 2023-02-09 05:02:59,876 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/28b6923310f04667b791122b1e41bb04 2023-02-09 05:02:59,876 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/9de80cbbea6c4eb1949beb5b876fdf6a to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/9de80cbbea6c4eb1949beb5b876fdf6a 2023-02-09 05:02:59,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/46895f65ac034981aeb07f5f185d6971 2023-02-09 05:02:59,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/b79951f5d5bd413081bc111373205103 2023-02-09 05:02:59,877 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/60b183d364b943209c619afbff5491c3 2023-02-09 05:02:59,877 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/837f257e55a24916aee2e8652c2df8f1 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/837f257e55a24916aee2e8652c2df8f1 2023-02-09 05:02:59,878 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/19a62367999049c8ab45d7debbe8b240 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/19a62367999049c8ab45d7debbe8b240 2023-02-09 05:02:59,879 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/9f555e85e1944c5bbd290f8cd15ca344 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f1/9f555e85e1944c5bbd290f8cd15ca344 2023-02-09 05:02:59,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f1/d2f3f533f8e14dfb95dda0ba1a6dc19f 2023-02-09 05:02:59,880 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/4aeb0422c5f642578fd7a9274baf8b06 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f1/4aeb0422c5f642578fd7a9274baf8b06 2023-02-09 05:02:59,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/recovered.edits/6.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224/recovered.edits/6.seqid 2023-02-09 05:02:59,880 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/b69e474f0ed6472a953a77bab8818ecf to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f1/b69e474f0ed6472a953a77bab8818ecf 2023-02-09 05:02:59,881 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/f7b66c1d6b4d489b9b31fa9e36264662 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f1/f7b66c1d6b4d489b9b31fa9e36264662 2023-02-09 05:02:59,881 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f1/f396241a35bc47a285e0c708024148ca 2023-02-09 05:02:59,882 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/f147cd0f1c2f15b7b26f0bbf3e6db224 2023-02-09 05:02:59,882 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:59,883 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f1/54643437399849afb46179bbfeca8e68 2023-02-09 05:02:59,890 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/recovered.edits] 2023-02-09 05:02:59,891 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/5eff2462c3734eb7ba850bb771dc3820 2023-02-09 05:02:59,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/74c9196bf7ed4905a818232035fd62c9 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/74c9196bf7ed4905a818232035fd62c9 2023-02-09 05:02:59,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/56bf3719d8e549b5a5f3b3bb552fc4ac to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/56bf3719d8e549b5a5f3b3bb552fc4ac 2023-02-09 05:02:59,894 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/283c0bcb328941f7addbff6a3e098a14 2023-02-09 05:02:59,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/44f2e7e9e0654d29a3c14d572d16901a to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/44f2e7e9e0654d29a3c14d572d16901a 2023-02-09 05:02:59,895 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/79cd5c631bdd44f99048f031213898f3 2023-02-09 05:02:59,895 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/02081774c7274f129b8e197e2b0a8637 2023-02-09 05:02:59,897 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/6d3f14f701844700bd2e030a472a9d08 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/f2/6d3f14f701844700bd2e030a472a9d08 2023-02-09 05:02:59,899 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/f2/d10e66d7856746599ad554995c4a7888 2023-02-09 05:02:59,899 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/f2/67741e04ea3444f695c4f51ed1180588 2023-02-09 05:02:59,900 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/f2/fe4893f5fb664de8ab700b6ef5d4b97d 2023-02-09 05:02:59,901 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/bd673a26c227467bac7fa12124cc3eaf to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/f2/bd673a26c227467bac7fa12124cc3eaf 2023-02-09 05:02:59,901 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/fecda8b8fa0344d88190d6d9dc606427 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/f2/fecda8b8fa0344d88190d6d9dc606427 2023-02-09 05:02:59,903 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/feae69e4c4d54e099f3b4c4f8c1fe44b to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/f2/feae69e4c4d54e099f3b4c4f8c1fe44b 2023-02-09 05:02:59,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/3430594b2a62443aa523526b5b722560 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/3430594b2a62443aa523526b5b722560 2023-02-09 05:02:59,908 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2/recovered.edits/12.seqid 2023-02-09 05:02:59,911 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21/recovered.edits/12.seqid 2023-02-09 05:02:59,911 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/9c62132e4ef9cf0a5a152457d6bd78c2 2023-02-09 05:02:59,911 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:59,912 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c/recovered.edits/12.seqid 2023-02-09 05:02:59,912 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401/recovered.edits/12.seqid 2023-02-09 05:02:59,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155/recovered.edits/12.seqid 2023-02-09 05:02:59,912 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45/recovered.edits/12.seqid 2023-02-09 05:02:59,913 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/3c8a28249336cf36d8d8434d419a7e21 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/17b027fca1c2f0776917ce61b08ff155 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/2e5bfd3c3aa7141f6cecac5be2d64401 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/1e87ed8f5222fbc0a0693ff6e4643f3c 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/7e4c7dfa24f86a1ec65cb15c2ade8c45 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f1/5599569411b9402a9fa8b222027a59b2 2023-02-09 05:02:59,914 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2/recovered.edits/12.seqid 2023-02-09 05:02:59,915 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f1, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/f2, FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/recovered.edits] 2023-02-09 05:02:59,916 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/0d53b6188118f1d68a68407cd3cef2d2 2023-02-09 05:02:59,920 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/35a196a4032f419a9ef121f6eb14ecc8 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/35a196a4032f419a9ef121f6eb14ecc8 2023-02-09 05:02:59,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362 to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/f2/496ae18f452d4e3e9669b37f30a5e362 2023-02-09 05:02:59,925 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/recovered.edits/6.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d/recovered.edits/6.seqid 2023-02-09 05:02:59,926 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/ac06087e1294746d47ae0d44332da21d 2023-02-09 05:02:59,927 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/recovered.edits/12.seqid to hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/archive/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2/recovered.edits/12.seqid 2023-02-09 05:02:59,928 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/.tmp/data/default/testWithMapReduce/4fdbdca6810c01b7e476eac809009ee2 2023-02-09 05:02:59,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 05:02:59,931 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,941 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:02:59,941 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:02:59,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 05:02:59,967 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-09 05:02:59,972 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,974 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918979974"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,980 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 05:02:59,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f147cd0f1c2f15b7b26f0bbf3e6db224, NAME => 'testWithMapReduce,,1675918968918.f147cd0f1c2f15b7b26f0bbf3e6db224.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 1e87ed8f5222fbc0a0693ff6e4643f3c, NAME => 'testWithMapReduce,aaa,1675918968918.1e87ed8f5222fbc0a0693ff6e4643f3c.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 9c62132e4ef9cf0a5a152457d6bd78c2, NAME => 'testWithMapReduce,d\x84\x84,1675918968918.9c62132e4ef9cf0a5a152457d6bd78c2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 7e4c7dfa24f86a1ec65cb15c2ade8c45, NAME => 'testWithMapReduce,g\xA7\xA7,1675918968918.7e4c7dfa24f86a1ec65cb15c2ade8c45.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 17b027fca1c2f0776917ce61b08ff155, NAME => 'testWithMapReduce,j\xCA\xCA,1675918968918.17b027fca1c2f0776917ce61b08ff155.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 2e5bfd3c3aa7141f6cecac5be2d64401, NAME => 'testWithMapReduce,m\xED\xED,1675918968918.2e5bfd3c3aa7141f6cecac5be2d64401.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 3c8a28249336cf36d8d8434d419a7e21, NAME => 'testWithMapReduce,q\x11\x10,1675918968918.3c8a28249336cf36d8d8434d419a7e21.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 0d53b6188118f1d68a68407cd3cef2d2, NAME => 'testWithMapReduce,t43,1675918968918.0d53b6188118f1d68a68407cd3cef2d2.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 4fdbdca6810c01b7e476eac809009ee2, NAME => 'testWithMapReduce,wWV,1675918968918.4fdbdca6810c01b7e476eac809009ee2.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => ac06087e1294746d47ae0d44332da21d, NAME => 'testWithMapReduce,zz{,1675918968918.ac06087e1294746d47ae0d44332da21d.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 05:02:59,980 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 05:02:59,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675918979980"}]},"ts":"9223372036854775807"} 2023-02-09 05:02:59,982 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 05:02:59,986 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:02:59,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 156 msec 2023-02-09 05:03:00,144 INFO [Listener at localhost/40479] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:00,144 INFO [Listener at localhost/40479] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:00,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46231] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 05:03:00,146 INFO [Listener at localhost/40479] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-09 05:03:00,146 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:00,146 INFO [Listener at localhost/40479] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:00,146 DEBUG [Listener at localhost/40479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29a3e046 to 127.0.0.1:63799 2023-02-09 05:03:00,147 DEBUG [Listener at localhost/40479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,147 DEBUG [Listener at localhost/40479] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:00,147 DEBUG [Listener at localhost/40479] util.JVMClusterUtil(257): Found active master hash=737379393, stopped=false 2023-02-09 05:03:00,147 INFO [Listener at localhost/40479] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:03:00,150 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:00,150 INFO [Listener at localhost/40479] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:00,150 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:00,150 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:00,150 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:00,151 DEBUG [Listener at localhost/40479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a9a02f3 to 127.0.0.1:63799 2023-02-09 05:03:00,151 DEBUG [Listener at localhost/40479] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:00,151 INFO [Listener at localhost/40479] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34441,1675918964998' ***** 2023-02-09 05:03:00,151 INFO [Listener at localhost/40479] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:00,151 INFO [Listener at localhost/40479] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40155,1675918965052' ***** 2023-02-09 05:03:00,151 INFO [Listener at localhost/40479] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:00,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:00,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:00,152 INFO [RS:0;jenkins-hbase4:34441] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:00,152 INFO [RS:1;jenkins-hbase4:40155] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:00,152 INFO [RS:1;jenkins-hbase4:40155] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:00,152 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:00,152 INFO [RS:0;jenkins-hbase4:34441] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:00,152 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:00,152 INFO [RS:0;jenkins-hbase4:34441] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:00,152 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(3304): Received CLOSE for 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:03:00,153 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:03:00,153 DEBUG [RS:0;jenkins-hbase4:34441] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26088d1e to 127.0.0.1:63799 2023-02-09 05:03:00,153 DEBUG [RS:0;jenkins-hbase4:34441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,153 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 05:03:00,153 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1479): Online Regions={75d93fd3b4af492fc3e2284a8a89ce96=hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96.} 2023-02-09 05:03:00,154 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1505): Waiting on 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:03:00,154 INFO [RS:1;jenkins-hbase4:40155] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:00,155 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:03:00,155 DEBUG [RS:1;jenkins-hbase4:40155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6afad036 to 127.0.0.1:63799 2023-02-09 05:03:00,155 DEBUG [RS:1;jenkins-hbase4:40155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,155 INFO [RS:1;jenkins-hbase4:40155] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:00,155 INFO [RS:1;jenkins-hbase4:40155] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:00,155 INFO [RS:1;jenkins-hbase4:40155] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:00,155 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:00,156 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 05:03:00,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 75d93fd3b4af492fc3e2284a8a89ce96, disabling compactions & flushes 2023-02-09 05:03:00,156 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 05:03:00,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:03:00,156 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 05:03:00,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:03:00,156 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:00,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. after waiting 0 ms 2023-02-09 05:03:00,156 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:00,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:00,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:03:00,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:00,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:00,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 75d93fd3b4af492fc3e2284a8a89ce96 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:00,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-09 05:03:00,178 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:00,178 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:00,355 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1505): Waiting on 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:03:00,356 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 05:03:00,493 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 05:03:00,493 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 05:03:00,555 DEBUG [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1505): Waiting on 75d93fd3b4af492fc3e2284a8a89ce96 2023-02-09 05:03:00,557 DEBUG [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 05:03:00,559 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 05:03:00,559 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 05:03:00,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/.tmp/info/3930d005ce5c4190ae2ce7c1d6886347 2023-02-09 05:03:00,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/info/2ba1e9af84844cca97f3edb4964ac3da 2023-02-09 05:03:00,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/.tmp/info/3930d005ce5c4190ae2ce7c1d6886347 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/info/3930d005ce5c4190ae2ce7c1d6886347 2023-02-09 05:03:00,585 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ba1e9af84844cca97f3edb4964ac3da 2023-02-09 05:03:00,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/info/3930d005ce5c4190ae2ce7c1d6886347, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:00,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 75d93fd3b4af492fc3e2284a8a89ce96 in 435ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:00,596 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/rep_barrier/a122cfdf1f61464290213e11b1e399a9 2023-02-09 05:03:00,602 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a122cfdf1f61464290213e11b1e399a9 2023-02-09 05:03:00,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/namespace/75d93fd3b4af492fc3e2284a8a89ce96/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:00,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:03:00,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 75d93fd3b4af492fc3e2284a8a89ce96: Waiting for close lock at 1675918980153Running coprocessor pre-close hooks at 1675918980153Disabling compacts and flushes for region at 1675918980153Disabling writes for close at 1675918980156 (+3 ms)Obtaining lock to block concurrent updates at 1675918980157 (+1 ms)Preparing flush snapshotting stores in 75d93fd3b4af492fc3e2284a8a89ce96 at 1675918980157Finished memstore snapshotting hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675918980157Flushing stores of hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. at 1675918980158 (+1 ms)Flushing 75d93fd3b4af492fc3e2284a8a89ce96/info: creating writer at 1675918980158Flushing 75d93fd3b4af492fc3e2284a8a89ce96/info: appending metadata at 1675918980162 (+4 ms)Flushing 75d93fd3b4af492fc3e2284a8a89ce96/info: closing flushed file at 1675918980162Flushing 75d93fd3b4af492fc3e2284a8a89ce96/info: reopening flushed file at 1675918980585 (+423 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 75d93fd3b4af492fc3e2284a8a89ce96 in 435ms, sequenceid=6, compaction requested=false at 1675918980592 (+7 ms)Writing region close event to WAL at 1675918980605 (+13 ms)Running coprocessor post-close hooks at 1675918980609 (+4 ms)Closed at 1675918980610 (+1 ms) 2023-02-09 05:03:00,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675918967901.75d93fd3b4af492fc3e2284a8a89ce96. 2023-02-09 05:03:00,623 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/table/f6b2316a8bf54781ae20653fb1dca75f 2023-02-09 05:03:00,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6b2316a8bf54781ae20653fb1dca75f 2023-02-09 05:03:00,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/info/2ba1e9af84844cca97f3edb4964ac3da as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/info/2ba1e9af84844cca97f3edb4964ac3da 2023-02-09 05:03:00,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ba1e9af84844cca97f3edb4964ac3da 2023-02-09 05:03:00,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/info/2ba1e9af84844cca97f3edb4964ac3da, entries=30, sequenceid=57, filesize=7.9 K 2023-02-09 05:03:00,638 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/rep_barrier/a122cfdf1f61464290213e11b1e399a9 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/rep_barrier/a122cfdf1f61464290213e11b1e399a9 2023-02-09 05:03:00,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a122cfdf1f61464290213e11b1e399a9 2023-02-09 05:03:00,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/rep_barrier/a122cfdf1f61464290213e11b1e399a9, entries=10, sequenceid=57, filesize=5.9 K 2023-02-09 05:03:00,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/.tmp/table/f6b2316a8bf54781ae20653fb1dca75f as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/table/f6b2316a8bf54781ae20653fb1dca75f 2023-02-09 05:03:00,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6b2316a8bf54781ae20653fb1dca75f 2023-02-09 05:03:00,653 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/table/f6b2316a8bf54781ae20653fb1dca75f, entries=13, sequenceid=57, filesize=5.9 K 2023-02-09 05:03:00,655 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 498ms, sequenceid=57, compaction requested=false 2023-02-09 05:03:00,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 05:03:00,667 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:00,668 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:00,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918980156Running coprocessor pre-close hooks at 1675918980156Disabling compacts and flushes for region at 1675918980156Disabling writes for close at 1675918980157 (+1 ms)Obtaining lock to block concurrent updates at 1675918980157Preparing flush snapshotting stores in 1588230740 at 1675918980157Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675918980157Flushing stores of hbase:meta,,1.1588230740 at 1675918980158 (+1 ms)Flushing 1588230740/info: creating writer at 1675918980158Flushing 1588230740/info: appending metadata at 1675918980165 (+7 ms)Flushing 1588230740/info: closing flushed file at 1675918980165Flushing 1588230740/rep_barrier: creating writer at 1675918980585 (+420 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675918980588 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675918980588Flushing 1588230740/table: creating writer at 1675918980603 (+15 ms)Flushing 1588230740/table: appending metadata at 1675918980613 (+10 ms)Flushing 1588230740/table: closing flushed file at 1675918980613Flushing 1588230740/info: reopening flushed file at 1675918980631 (+18 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675918980638 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1675918980645 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 498ms, sequenceid=57, compaction requested=false at 1675918980655 (+10 ms)Writing region close event to WAL at 1675918980663 (+8 ms)Running coprocessor post-close hooks at 1675918980667 (+4 ms)Closed at 1675918980668 (+1 ms) 2023-02-09 05:03:00,669 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:00,755 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34441,1675918964998; all regions closed. 2023-02-09 05:03:00,757 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40155,1675918965052; all regions closed. 2023-02-09 05:03:00,765 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/WALs/jenkins-hbase4.apache.org,40155,1675918965052/jenkins-hbase4.apache.org%2C40155%2C1675918965052.meta.1675918967620.meta not finished, retry = 0 2023-02-09 05:03:00,768 DEBUG [RS:0;jenkins-hbase4:34441] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs 2023-02-09 05:03:00,768 INFO [RS:0;jenkins-hbase4:34441] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34441%2C1675918964998:(num 1675918968482) 2023-02-09 05:03:00,768 DEBUG [RS:0;jenkins-hbase4:34441] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,768 INFO [RS:0;jenkins-hbase4:34441] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:00,769 INFO [RS:0;jenkins-hbase4:34441] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:00,769 INFO [RS:0;jenkins-hbase4:34441] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:00,769 INFO [RS:0;jenkins-hbase4:34441] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:00,769 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:00,769 INFO [RS:0;jenkins-hbase4:34441] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:00,770 INFO [RS:0;jenkins-hbase4:34441] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34441 2023-02-09 05:03:00,777 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:03:00,777 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:00,777 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34441,1675918964998 2023-02-09 05:03:00,777 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:00,777 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:00,778 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34441,1675918964998] 2023-02-09 05:03:00,778 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34441,1675918964998; numProcessing=1 2023-02-09 05:03:00,781 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34441,1675918964998 already deleted, retry=false 2023-02-09 05:03:00,781 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34441,1675918964998 expired; onlineServers=1 2023-02-09 05:03:00,869 DEBUG [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs 2023-02-09 05:03:00,869 INFO [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40155%2C1675918965052.meta:.meta(num 1675918967620) 2023-02-09 05:03:00,874 DEBUG [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/oldWALs 2023-02-09 05:03:00,874 INFO [RS:1;jenkins-hbase4:40155] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40155%2C1675918965052:(num 1675918968524) 2023-02-09 05:03:00,874 DEBUG [RS:1;jenkins-hbase4:40155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,874 INFO [RS:1;jenkins-hbase4:40155] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:00,874 INFO [RS:1;jenkins-hbase4:40155] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:00,875 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:00,876 INFO [RS:1;jenkins-hbase4:40155] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40155 2023-02-09 05:03:00,878 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40155,1675918965052 2023-02-09 05:03:00,878 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:00,879 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@63d29356 rejected from java.util.concurrent.ThreadPoolExecutor@67ed0bf4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:00,879 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:00,879 INFO [RS:0;jenkins-hbase4:34441] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34441,1675918964998; zookeeper connection closed. 2023-02-09 05:03:00,879 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b3b22f0 rejected from java.util.concurrent.ThreadPoolExecutor@4f04bf4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:00,879 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:34441-0x1003775da5a0001, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:00,879 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@503c8d72] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@503c8d72 2023-02-09 05:03:00,879 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@29f84898 rejected from java.util.concurrent.ThreadPoolExecutor@4f04bf4f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:00,881 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40155,1675918965052] 2023-02-09 05:03:00,881 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40155,1675918965052; numProcessing=2 2023-02-09 05:03:00,882 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40155,1675918965052 already deleted, retry=false 2023-02-09 05:03:00,882 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40155,1675918965052 expired; onlineServers=0 2023-02-09 05:03:00,882 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46231,1675918963742' ***** 2023-02-09 05:03:00,882 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:00,882 DEBUG [M:0;jenkins-hbase4:46231] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ace8e7a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:00,882 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46231,1675918963742 2023-02-09 05:03:00,883 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46231,1675918963742; all regions closed. 2023-02-09 05:03:00,883 DEBUG [M:0;jenkins-hbase4:46231] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:00,883 DEBUG [M:0;jenkins-hbase4:46231] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:00,883 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:00,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918966357] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918966357,5,FailOnTimeoutGroup] 2023-02-09 05:03:00,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918966356] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918966356,5,FailOnTimeoutGroup] 2023-02-09 05:03:00,883 DEBUG [M:0;jenkins-hbase4:46231] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:00,884 INFO [M:0;jenkins-hbase4:46231] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:00,884 INFO [M:0;jenkins-hbase4:46231] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:00,884 INFO [M:0;jenkins-hbase4:46231] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:00,884 DEBUG [M:0;jenkins-hbase4:46231] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:00,884 INFO [M:0;jenkins-hbase4:46231] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:00,884 ERROR [M:0;jenkins-hbase4:46231] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-09 05:03:00,886 INFO [M:0;jenkins-hbase4:46231] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:00,887 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:00,887 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:00,888 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:00,888 DEBUG [M:0;jenkins-hbase4:46231] zookeeper.ZKUtil(398): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:00,888 WARN [M:0;jenkins-hbase4:46231] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:00,888 INFO [M:0;jenkins-hbase4:46231] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:00,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:00,888 INFO [M:0;jenkins-hbase4:46231] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:00,889 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:00,889 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:00,889 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:00,889 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:00,889 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:00,889 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.28 KB heapSize=192.19 KB 2023-02-09 05:03:00,918 INFO [M:0;jenkins-hbase4:46231] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.28 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/152ab900423c4d89b23e52b708d0d724 2023-02-09 05:03:00,925 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/152ab900423c4d89b23e52b708d0d724 as hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/152ab900423c4d89b23e52b708d0d724 2023-02-09 05:03:00,930 INFO [M:0;jenkins-hbase4:46231] regionserver.HStore(1080): Added hdfs://localhost:38613/user/jenkins/test-data/f6530452-3a06-e50c-3c92-f6d93c901e2c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/152ab900423c4d89b23e52b708d0d724, entries=53, sequenceid=357, filesize=10.4 K 2023-02-09 05:03:00,931 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(2947): Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=357, compaction requested=false 2023-02-09 05:03:00,933 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:00,933 DEBUG [M:0;jenkins-hbase4:46231] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918980888Disabling compacts and flushes for region at 1675918980888Disabling writes for close at 1675918980889 (+1 ms)Obtaining lock to block concurrent updates at 1675918980889Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675918980889Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163106, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1675918980889Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675918980890 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675918980890Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675918980894 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675918980894Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675918980925 (+31 ms)Finished flush of dataSize ~159.28 KB/163106, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 42ms, sequenceid=357, compaction requested=false at 1675918980931 (+6 ms)Writing region close event to WAL at 1675918980933 (+2 ms)Closed at 1675918980933 2023-02-09 05:03:00,936 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:00,936 INFO [M:0;jenkins-hbase4:46231] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:00,936 INFO [M:0;jenkins-hbase4:46231] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46231 2023-02-09 05:03:00,939 DEBUG [M:0;jenkins-hbase4:46231] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46231,1675918963742 already deleted, retry=false 2023-02-09 05:03:00,980 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:00,980 INFO [RS:1;jenkins-hbase4:40155] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40155,1675918965052; zookeeper connection closed. 2023-02-09 05:03:00,981 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6438dcf4 rejected from java.util.concurrent.ThreadPoolExecutor@67ed0bf4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:00,981 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@177bf998] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@177bf998 2023-02-09 05:03:00,981 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): regionserver:40155-0x1003775da5a0002, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:00,981 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c3aa039 rejected from java.util.concurrent.ThreadPoolExecutor@67ed0bf4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:00,981 INFO [Listener at localhost/40479] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:01,081 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:01,081 INFO [M:0;jenkins-hbase4:46231] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46231,1675918963742; zookeeper connection closed. 2023-02-09 05:03:01,081 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@460e061d rejected from java.util.concurrent.ThreadPoolExecutor@79694b77[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:01,081 DEBUG [Listener at localhost/40479-EventThread] zookeeper.ZKWatcher(600): master:46231-0x1003775da5a0000, quorum=127.0.0.1:63799, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:01,081 ERROR [Listener at localhost/40479-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@67e4e6cc rejected from java.util.concurrent.ThreadPoolExecutor@79694b77[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:01,083 WARN [Listener at localhost/40479] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:01,090 INFO [Listener at localhost/40479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:01,195 WARN [BP-650818172-172.31.14.131-1675918960106 heartbeating to localhost/127.0.0.1:38613] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:01,195 WARN [BP-650818172-172.31.14.131-1675918960106 heartbeating to localhost/127.0.0.1:38613] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-650818172-172.31.14.131-1675918960106 (Datanode Uuid ccf4b9ff-288b-46dc-b421-e21a3ebb9b79) service to localhost/127.0.0.1:38613 2023-02-09 05:03:01,197 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/dfs/data/data3/current/BP-650818172-172.31.14.131-1675918960106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:01,197 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/dfs/data/data4/current/BP-650818172-172.31.14.131-1675918960106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:01,199 WARN [Listener at localhost/40479] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:01,206 INFO [Listener at localhost/40479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:01,310 WARN [BP-650818172-172.31.14.131-1675918960106 heartbeating to localhost/127.0.0.1:38613] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:01,310 WARN [BP-650818172-172.31.14.131-1675918960106 heartbeating to localhost/127.0.0.1:38613] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-650818172-172.31.14.131-1675918960106 (Datanode Uuid 6f2d5054-2712-4772-9ba2-e771d7b3c710) service to localhost/127.0.0.1:38613 2023-02-09 05:03:01,311 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/dfs/data/data1/current/BP-650818172-172.31.14.131-1675918960106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:01,311 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/cluster_8ec68df9-5418-9b22-8451-c839f38b2cc0/dfs/data/data2/current/BP-650818172-172.31.14.131-1675918960106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:01,346 INFO [Listener at localhost/40479] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:01,467 INFO [Listener at localhost/40479] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:01,540 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:01,557 INFO [Listener at localhost/40479] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=102 (was 7) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:38613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,46231,1675918963742)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@7ab695fe java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38613 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/40479 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38613 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=289 (was 188) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3971 (was 5069) 2023-02-09 05:03:01,567 INFO [Listener at localhost/40479] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=102, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=289, ProcessCount=168, AvailableMemoryMB=3971 2023-02-09 05:03:01,578 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.log.dir so I do NOT create it in target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c 2023-02-09 05:03:01,578 WARN [Listener at localhost/40479] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:01,578 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.tmp.dir so I do NOT create it in target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c 2023-02-09 05:03:01,578 WARN [Listener at localhost/40479] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e210fe92-bf0f-f23a-4d7a-12f8c6a868d8/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:01,578 DEBUG [Listener at localhost/40479] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c 2023-02-09 05:03:01,578 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:01,578 INFO [Listener at localhost/40479] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b, deleteOnExit=true 2023-02-09 05:03:01,578 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/test.cache.data in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:01,579 DEBUG [Listener at localhost/40479] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:01,579 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:01,580 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:01,581 INFO [Listener at localhost/40479] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:01,585 WARN [Listener at localhost/40479] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:01,585 WARN [Listener at localhost/40479] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:01,639 WARN [Listener at localhost/40479] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:01,641 INFO [Listener at localhost/40479] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:01,649 INFO [Listener at localhost/40479] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/java.io.tmpdir/Jetty_localhost_34275_hdfs____.vmzq2v/webapp 2023-02-09 05:03:01,765 INFO [Listener at localhost/40479] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34275 2023-02-09 05:03:01,769 WARN [Listener at localhost/40479] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:01,769 WARN [Listener at localhost/40479] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:01,809 WARN [Listener at localhost/42695] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:01,825 WARN [Listener at localhost/42695] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:01,828 WARN [Listener at localhost/42695] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:01,829 INFO [Listener at localhost/42695] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:01,835 INFO [Listener at localhost/42695] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/java.io.tmpdir/Jetty_localhost_45413_datanode____.nap8is/webapp 2023-02-09 05:03:01,927 INFO [Listener at localhost/42695] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45413 2023-02-09 05:03:01,936 WARN [Listener at localhost/36059] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:01,951 WARN [Listener at localhost/36059] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:01,953 WARN [Listener at localhost/36059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:01,954 INFO [Listener at localhost/36059] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:01,957 INFO [Listener at localhost/36059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/java.io.tmpdir/Jetty_localhost_44931_datanode____vrb3ni/webapp 2023-02-09 05:03:02,042 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fdd3dc6c6be6108: Processing first storage report for DS-989f726e-019f-419f-a97a-d6e4688eafa3 from datanode dc34cd5e-a998-4723-b4d9-61a212dd9fbb 2023-02-09 05:03:02,043 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fdd3dc6c6be6108: from storage DS-989f726e-019f-419f-a97a-d6e4688eafa3 node DatanodeRegistration(127.0.0.1:43503, datanodeUuid=dc34cd5e-a998-4723-b4d9-61a212dd9fbb, infoPort=40549, infoSecurePort=0, ipcPort=36059, storageInfo=lv=-57;cid=testClusterID;nsid=2130831708;c=1675918981587), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:02,043 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4fdd3dc6c6be6108: Processing first storage report for DS-d71a5437-dfba-4cb0-9aef-612f5274d310 from datanode dc34cd5e-a998-4723-b4d9-61a212dd9fbb 2023-02-09 05:03:02,043 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4fdd3dc6c6be6108: from storage DS-d71a5437-dfba-4cb0-9aef-612f5274d310 node DatanodeRegistration(127.0.0.1:43503, datanodeUuid=dc34cd5e-a998-4723-b4d9-61a212dd9fbb, infoPort=40549, infoSecurePort=0, ipcPort=36059, storageInfo=lv=-57;cid=testClusterID;nsid=2130831708;c=1675918981587), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:02,068 INFO [Listener at localhost/36059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44931 2023-02-09 05:03:02,079 WARN [Listener at localhost/44057] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:02,187 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb6777c620967cb66: Processing first storage report for DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9 from datanode 3696a2ef-26ad-4722-b505-a658d27a77b6 2023-02-09 05:03:02,188 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb6777c620967cb66: from storage DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9 node DatanodeRegistration(127.0.0.1:40787, datanodeUuid=3696a2ef-26ad-4722-b505-a658d27a77b6, infoPort=42839, infoSecurePort=0, ipcPort=44057, storageInfo=lv=-57;cid=testClusterID;nsid=2130831708;c=1675918981587), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:02,188 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb6777c620967cb66: Processing first storage report for DS-e5250236-e157-4e14-b43c-b4350c741549 from datanode 3696a2ef-26ad-4722-b505-a658d27a77b6 2023-02-09 05:03:02,188 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb6777c620967cb66: from storage DS-e5250236-e157-4e14-b43c-b4350c741549 node DatanodeRegistration(127.0.0.1:40787, datanodeUuid=3696a2ef-26ad-4722-b505-a658d27a77b6, infoPort=42839, infoSecurePort=0, ipcPort=44057, storageInfo=lv=-57;cid=testClusterID;nsid=2130831708;c=1675918981587), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:02,191 DEBUG [Listener at localhost/44057] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c 2023-02-09 05:03:02,196 INFO [Listener at localhost/44057] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/zookeeper_0, clientPort=53139, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:02,198 INFO [Listener at localhost/44057] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53139 2023-02-09 05:03:02,198 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,200 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,241 INFO [Listener at localhost/44057] util.FSUtils(479): Created version file at hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99 with version=8 2023-02-09 05:03:02,241 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,243 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,244 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/hbase-staging 2023-02-09 05:03:02,246 INFO [Listener at localhost/44057] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:02,247 INFO [Listener at localhost/44057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:02,249 INFO [Listener at localhost/44057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40289 2023-02-09 05:03:02,250 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,251 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,252 INFO [Listener at localhost/44057] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40289 connecting to ZooKeeper ensemble=127.0.0.1:53139 2023-02-09 05:03:02,261 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:402890x0, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:02,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40289-0x100377625f60000 connected 2023-02-09 05:03:02,285 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:02,286 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:02,286 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:02,290 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40289 2023-02-09 05:03:02,290 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40289 2023-02-09 05:03:02,293 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40289 2023-02-09 05:03:02,294 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40289 2023-02-09 05:03:02,296 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40289 2023-02-09 05:03:02,296 INFO [Listener at localhost/44057] master.HMaster(439): hbase.rootdir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99, hbase.cluster.distributed=false 2023-02-09 05:03:02,310 INFO [Listener at localhost/44057] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:02,310 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,310 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,311 INFO [Listener at localhost/44057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:02,311 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,311 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:02,311 INFO [Listener at localhost/44057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:02,314 INFO [Listener at localhost/44057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39429 2023-02-09 05:03:02,315 INFO [Listener at localhost/44057] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:02,317 DEBUG [Listener at localhost/44057] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:02,317 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,318 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,319 INFO [Listener at localhost/44057] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39429 connecting to ZooKeeper ensemble=127.0.0.1:53139 2023-02-09 05:03:02,323 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:394290x0, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:02,324 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:394290x0, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:02,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39429-0x100377625f60001 connected 2023-02-09 05:03:02,325 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:02,325 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:02,332 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-09 05:03:02,332 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39429 2023-02-09 05:03:02,332 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39429 2023-02-09 05:03:02,336 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-09 05:03:02,340 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39429 2023-02-09 05:03:02,352 INFO [Listener at localhost/44057] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:02,352 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,353 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,353 INFO [Listener at localhost/44057] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:02,353 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:02,353 INFO [Listener at localhost/44057] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:02,353 INFO [Listener at localhost/44057] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:02,355 INFO [Listener at localhost/44057] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46559 2023-02-09 05:03:02,355 INFO [Listener at localhost/44057] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:02,356 DEBUG [Listener at localhost/44057] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:02,356 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,357 INFO [Listener at localhost/44057] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,358 INFO [Listener at localhost/44057] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46559 connecting to ZooKeeper ensemble=127.0.0.1:53139 2023-02-09 05:03:02,362 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:465590x0, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:02,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46559-0x100377625f60002 connected 2023-02-09 05:03:02,363 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:02,364 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:02,364 DEBUG [Listener at localhost/44057] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:02,368 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46559 2023-02-09 05:03:02,370 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46559 2023-02-09 05:03:02,370 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46559 2023-02-09 05:03:02,371 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46559 2023-02-09 05:03:02,371 DEBUG [Listener at localhost/44057] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46559 2023-02-09 05:03:02,376 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,378 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:02,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,379 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:02,379 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:02,379 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:02,381 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:02,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40289,1675918982246 from backup master directory 2023-02-09 05:03:02,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:02,383 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,383 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:02,383 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:02,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/hbase.id with ID: 812e616f-e7bc-4309-9cee-588d09b1ff51 2023-02-09 05:03:02,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:02,415 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1befa02c to 127.0.0.1:53139 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:02,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24697aed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:02,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:02,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:02,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:02,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store-tmp 2023-02-09 05:03:02,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:02,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:02,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:02,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:02,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:02,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:02,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:02,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918982443Disabling compacts and flushes for region at 1675918982443Disabling writes for close at 1675918982444 (+1 ms)Writing region close event to WAL at 1675918982444Closed at 1675918982444 2023-02-09 05:03:02,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/WALs/jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40289%2C1675918982246, suffix=, logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/WALs/jenkins-hbase4.apache.org,40289,1675918982246, archiveDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:02,469 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK] 2023-02-09 05:03:02,471 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK] 2023-02-09 05:03:02,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/WALs/jenkins-hbase4.apache.org,40289,1675918982246/jenkins-hbase4.apache.org%2C40289%2C1675918982246.1675918982447 2023-02-09 05:03:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK], DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK]] 2023-02-09 05:03:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,476 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,477 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:02,477 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:02,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:02,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:02,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61690317, jitterRate=-0.08074264228343964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:02,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675918982475Initializing all the Stores at 1675918982475Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918982475Cleaning up temporary data from old regions at 1675918982480 (+5 ms)Cleaning up detritus from prior splits at 1675918982480Region opened successfully at 1675918982484 (+4 ms) 2023-02-09 05:03:02,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:02,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:02,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:02,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:02,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:02,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:02,487 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:02,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:02,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:02,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:02,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:02,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:02,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:02,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:02,506 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:02,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:02,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:02,508 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:02,508 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:02,508 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,508 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:02,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40289,1675918982246, sessionid=0x100377625f60000, setting cluster-up flag (Was=false) 2023-02-09 05:03:02,515 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:02,521 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,523 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:02,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:02,530 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/.tmp 2023-02-09 05:03:02,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:02,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919012540 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:02,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:02,542 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:02,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:02,542 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:02,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:02,544 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:02,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:02,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:02,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918982544,5,FailOnTimeoutGroup] 2023-02-09 05:03:02,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918982544,5,FailOnTimeoutGroup] 2023-02-09 05:03:02,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:02,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,563 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:02,563 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:02,564 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99 2023-02-09 05:03:02,574 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(952): ClusterId : 812e616f-e7bc-4309-9cee-588d09b1ff51 2023-02-09 05:03:02,574 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(952): ClusterId : 812e616f-e7bc-4309-9cee-588d09b1ff51 2023-02-09 05:03:02,574 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:02,574 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:02,576 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:02,576 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:02,578 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:02,580 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:02,580 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:02,580 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ReadOnlyZKClient(139): Connect 0x5d116a09 to 127.0.0.1:53139 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:02,580 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:02,583 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:02,585 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:02,585 DEBUG [RS:1;jenkins-hbase4:46559] zookeeper.ReadOnlyZKClient(139): Connect 0x3f537c5b to 127.0.0.1:53139 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:02,587 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/info 2023-02-09 05:03:02,587 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:02,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,588 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:02,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:02,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:02,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:02,591 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/table 2023-02-09 05:03:02,592 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:02,593 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53d69fdb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:02,593 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57e90179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:02,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,594 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740 2023-02-09 05:03:02,595 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740 2023-02-09 05:03:02,595 DEBUG [RS:1;jenkins-hbase4:46559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@319495c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:02,595 DEBUG [RS:1;jenkins-hbase4:46559] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35ab172b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:02,598 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:02,599 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:02,601 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70005235, jitterRate=0.04315929114818573}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675918982580Initializing all the Stores at 1675918982582 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918982582Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918982584 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918982584Cleaning up temporary data from old regions at 1675918982596 (+12 ms)Cleaning up detritus from prior splits at 1675918982597 (+1 ms)Region opened successfully at 1675918982601 (+4 ms) 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:02,601 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:02,601 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:02,604 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:02,604 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918982601Disabling compacts and flushes for region at 1675918982601Disabling writes for close at 1675918982601Writing region close event to WAL at 1675918982604 (+3 ms)Closed at 1675918982604 2023-02-09 05:03:02,605 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:02,605 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:02,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:02,605 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39429 2023-02-09 05:03:02,606 INFO [RS:0;jenkins-hbase4:39429] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:02,606 INFO [RS:0;jenkins-hbase4:39429] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:02,606 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:02,606 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40289,1675918982246 with isa=jenkins-hbase4.apache.org/172.31.14.131:39429, startcode=1675918982310 2023-02-09 05:03:02,607 DEBUG [RS:0;jenkins-hbase4:39429] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:02,608 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:02,610 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:02,612 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46559 2023-02-09 05:03:02,613 INFO [RS:1;jenkins-hbase4:46559] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:02,613 INFO [RS:1;jenkins-hbase4:46559] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:02,613 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:02,614 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40289,1675918982246 with isa=jenkins-hbase4.apache.org/172.31.14.131:46559, startcode=1675918982352 2023-02-09 05:03:02,614 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35863, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:02,614 DEBUG [RS:1;jenkins-hbase4:46559] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:02,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,616 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99 2023-02-09 05:03:02,616 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42695 2023-02-09 05:03:02,616 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:02,618 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:02,618 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,618 WARN [RS:0;jenkins-hbase4:39429] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:02,618 INFO [RS:0;jenkins-hbase4:39429] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:02,618 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,621 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59493, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:02,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,622 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39429,1675918982310] 2023-02-09 05:03:02,622 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99 2023-02-09 05:03:02,622 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42695 2023-02-09 05:03:02,622 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:02,627 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:02,628 DEBUG [RS:1;jenkins-hbase4:46559] zookeeper.ZKUtil(162): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,628 WARN [RS:1;jenkins-hbase4:46559] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:02,628 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46559,1675918982352] 2023-02-09 05:03:02,628 INFO [RS:1;jenkins-hbase4:46559] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:02,628 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,628 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,629 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ZKUtil(162): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,630 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:02,630 INFO [RS:0;jenkins-hbase4:39429] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:02,636 INFO [RS:0;jenkins-hbase4:39429] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:02,638 DEBUG [RS:1;jenkins-hbase4:46559] zookeeper.ZKUtil(162): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,638 DEBUG [RS:1;jenkins-hbase4:46559] zookeeper.ZKUtil(162): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,639 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:02,639 INFO [RS:1;jenkins-hbase4:46559] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:02,640 INFO [RS:0;jenkins-hbase4:39429] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:02,640 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,643 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:02,643 INFO [RS:1;jenkins-hbase4:46559] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:02,644 INFO [RS:1;jenkins-hbase4:46559] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:02,644 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,648 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:02,648 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:0;jenkins-hbase4:39429] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,649 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:02,650 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,650 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,650 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,651 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,651 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,651 DEBUG [RS:1;jenkins-hbase4:46559] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:02,657 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,657 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,657 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,665 INFO [RS:0;jenkins-hbase4:39429] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:02,665 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39429,1675918982310-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,677 INFO [RS:1;jenkins-hbase4:46559] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:02,677 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46559,1675918982352-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,680 INFO [RS:0;jenkins-hbase4:39429] regionserver.Replication(203): jenkins-hbase4.apache.org,39429,1675918982310 started 2023-02-09 05:03:02,680 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39429,1675918982310, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39429, sessionid=0x100377625f60001 2023-02-09 05:03:02,680 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:02,680 DEBUG [RS:0;jenkins-hbase4:39429] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,680 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39429,1675918982310' 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39429,1675918982310' 2023-02-09 05:03:02,681 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:02,682 DEBUG [RS:0;jenkins-hbase4:39429] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:02,682 DEBUG [RS:0;jenkins-hbase4:39429] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:02,682 INFO [RS:0;jenkins-hbase4:39429] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:02,682 INFO [RS:0;jenkins-hbase4:39429] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:02,696 INFO [RS:1;jenkins-hbase4:46559] regionserver.Replication(203): jenkins-hbase4.apache.org,46559,1675918982352 started 2023-02-09 05:03:02,696 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46559,1675918982352, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46559, sessionid=0x100377625f60002 2023-02-09 05:03:02,697 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:02,697 DEBUG [RS:1;jenkins-hbase4:46559] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,697 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46559,1675918982352' 2023-02-09 05:03:02,697 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:02,697 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46559,1675918982352' 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:02,698 DEBUG [RS:1;jenkins-hbase4:46559] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:02,699 DEBUG [RS:1;jenkins-hbase4:46559] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:02,699 INFO [RS:1;jenkins-hbase4:46559] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:02,699 INFO [RS:1;jenkins-hbase4:46559] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:02,762 DEBUG [jenkins-hbase4:40289] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:02,762 DEBUG [jenkins-hbase4:40289] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:02,764 DEBUG [jenkins-hbase4:40289] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:02,764 DEBUG [jenkins-hbase4:40289] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:02,765 DEBUG [jenkins-hbase4:40289] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:02,765 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46559,1675918982352, state=OPENING 2023-02-09 05:03:02,767 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:02,768 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:02,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:02,769 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:02,923 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:02,923 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:02,926 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59240, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:02,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:02,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:02,932 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46559%2C1675918982352.meta, suffix=.meta, logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352, archiveDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs, maxLogs=32 2023-02-09 05:03:02,948 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK] 2023-02-09 05:03:02,948 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK] 2023-02-09 05:03:02,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352/jenkins-hbase4.apache.org%2C46559%2C1675918982352.meta.1675918982933.meta 2023-02-09 05:03:02,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK]] 2023-02-09 05:03:02,953 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:02,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:02,954 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:02,955 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:02,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:02,956 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:02,956 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:02,956 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:02,958 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:02,959 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/info 2023-02-09 05:03:02,959 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/info 2023-02-09 05:03:02,959 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:02,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,960 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:02,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:02,961 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:02,961 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:02,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,961 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:02,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/table 2023-02-09 05:03:02,962 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/table 2023-02-09 05:03:02,962 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:02,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:02,964 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740 2023-02-09 05:03:02,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740 2023-02-09 05:03:02,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:02,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:02,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69731698, jitterRate=0.039083272218704224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:02,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675918982956Writing region info on filesystem at 1675918982956Initializing all the Stores at 1675918982957 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918982957Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918982957Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918982957Cleaning up temporary data from old regions at 1675918982966 (+9 ms)Cleaning up detritus from prior splits at 1675918982966Running coprocessor post-open hooks at 1675918982969 (+3 ms)Region opened successfully at 1675918982969 2023-02-09 05:03:02,970 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675918982923 2023-02-09 05:03:02,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:02,975 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:02,976 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46559,1675918982352, state=OPEN 2023-02-09 05:03:02,977 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:02,977 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:02,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:02,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46559,1675918982352 in 208 msec 2023-02-09 05:03:02,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:02,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 374 msec 2023-02-09 05:03:02,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 452 msec 2023-02-09 05:03:02,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675918982378, completionTime=-1 2023-02-09 05:03:02,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:02,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:02,986 DEBUG [hconnection-0xc63b6f1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:02,988 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:02,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:02,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919042990 2023-02-09 05:03:02,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919102991 2023-02-09 05:03:02,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40289,1675918982246-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40289,1675918982246-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40289,1675918982246-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40289, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:02,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:02,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:03,002 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:03,006 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:03,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:03,008 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,009 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802 empty. 2023-02-09 05:03:03,009 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:03,024 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:03,025 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 08358f8db3ba23969606f5eb18aeb802, NAME => 'hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 08358f8db3ba23969606f5eb18aeb802, disabling compactions & flushes 2023-02-09 05:03:03,441 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. after waiting 0 ms 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,441 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,441 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 08358f8db3ba23969606f5eb18aeb802: Waiting for close lock at 1675918983441Disabling compacts and flushes for region at 1675918983441Disabling writes for close at 1675918983441Writing region close event to WAL at 1675918983441Closed at 1675918983441 2023-02-09 05:03:03,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:03,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918983445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983445"}]},"ts":"1675918983445"} 2023-02-09 05:03:03,447 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:03,448 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:03,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918983448"}]},"ts":"1675918983448"} 2023-02-09 05:03:03,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:03,453 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:03,453 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:03,454 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:03,454 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:03,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=08358f8db3ba23969606f5eb18aeb802, ASSIGN}] 2023-02-09 05:03:03,456 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=08358f8db3ba23969606f5eb18aeb802, ASSIGN 2023-02-09 05:03:03,457 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=08358f8db3ba23969606f5eb18aeb802, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:03,607 INFO [jenkins-hbase4:40289] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:03,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=08358f8db3ba23969606f5eb18aeb802, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:03,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918983608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918983608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918983608"}]},"ts":"1675918983608"} 2023-02-09 05:03:03,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 08358f8db3ba23969606f5eb18aeb802, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:03,684 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39429%2C1675918982310, suffix=, logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,39429,1675918982310, archiveDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs, maxLogs=32 2023-02-09 05:03:03,704 INFO [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46559%2C1675918982352, suffix=, logDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352, archiveDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs, maxLogs=32 2023-02-09 05:03:03,704 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK] 2023-02-09 05:03:03,704 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK] 2023-02-09 05:03:03,710 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,39429,1675918982310/jenkins-hbase4.apache.org%2C39429%2C1675918982310.1675918983685 2023-02-09 05:03:03,712 DEBUG [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK]] 2023-02-09 05:03:03,721 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK] 2023-02-09 05:03:03,722 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK] 2023-02-09 05:03:03,725 INFO [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352/jenkins-hbase4.apache.org%2C46559%2C1675918982352.1675918983705 2023-02-09 05:03:03,726 DEBUG [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40787,DS-7d27d65d-ca88-4b71-a04d-30028f4a0ba9,DISK], DatanodeInfoWithStorage[127.0.0.1:43503,DS-989f726e-019f-419f-a97a-d6e4688eafa3,DISK]] 2023-02-09 05:03:03,763 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:03,764 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:03,767 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41640, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:03,770 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08358f8db3ba23969606f5eb18aeb802, NAME => 'hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:03,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,773 INFO [StoreOpener-08358f8db3ba23969606f5eb18aeb802-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,775 DEBUG [StoreOpener-08358f8db3ba23969606f5eb18aeb802-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/info 2023-02-09 05:03:03,775 DEBUG [StoreOpener-08358f8db3ba23969606f5eb18aeb802-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/info 2023-02-09 05:03:03,775 INFO [StoreOpener-08358f8db3ba23969606f5eb18aeb802-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08358f8db3ba23969606f5eb18aeb802 columnFamilyName info 2023-02-09 05:03:03,776 INFO [StoreOpener-08358f8db3ba23969606f5eb18aeb802-1] regionserver.HStore(310): Store=08358f8db3ba23969606f5eb18aeb802/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:03,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:03,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:03,783 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08358f8db3ba23969606f5eb18aeb802; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75367808, jitterRate=0.12306785583496094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:03,783 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08358f8db3ba23969606f5eb18aeb802: Running coprocessor pre-open hook at 1675918983771Writing region info on filesystem at 1675918983771Initializing all the Stores at 1675918983772 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918983772Cleaning up temporary data from old regions at 1675918983778 (+6 ms)Cleaning up detritus from prior splits at 1675918983778Running coprocessor post-open hooks at 1675918983783 (+5 ms)Region opened successfully at 1675918983783 2023-02-09 05:03:03,784 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802., pid=6, masterSystemTime=1675918983763 2023-02-09 05:03:03,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:03,789 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=08358f8db3ba23969606f5eb18aeb802, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:03,790 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918983789"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918983789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918983789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918983789"}]},"ts":"1675918983789"} 2023-02-09 05:03:03,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:03,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 08358f8db3ba23969606f5eb18aeb802, server=jenkins-hbase4.apache.org,39429,1675918982310 in 181 msec 2023-02-09 05:03:03,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:03,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=08358f8db3ba23969606f5eb18aeb802, ASSIGN in 340 msec 2023-02-09 05:03:03,797 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:03,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918983797"}]},"ts":"1675918983797"} 2023-02-09 05:03:03,799 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:03,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:03,807 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:03,808 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:03,809 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:03,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 809 msec 2023-02-09 05:03:03,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:03,821 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41654, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:03,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:03,833 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:03,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-09 05:03:03,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:03,854 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:03,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-09 05:03:03,870 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:03,873 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:03,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.489sec 2023-02-09 05:03:03,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:03,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:03,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:03,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40289,1675918982246-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:03,874 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40289,1675918982246-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:03,874 DEBUG [Listener at localhost/44057] zookeeper.ReadOnlyZKClient(139): Connect 0x541141ad to 127.0.0.1:53139 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:03,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:03,879 DEBUG [Listener at localhost/44057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44209209, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:03,880 DEBUG [hconnection-0x27f81525-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:03,883 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:03,885 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:03,885 DEBUG [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:03,885 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:03,885 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:03,887 DEBUG [Listener at localhost/44057] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:03,888 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55744, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:03,889 INFO [Listener at localhost/44057] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 05:03:03,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 05:03:03,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:03,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:55744 deadline: 1675919043889, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 05:03:03,890 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 05:03:03,890 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:03,891 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:03,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:03,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 05:03:03,896 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:03,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 05:03:03,896 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:03,897 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:03,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:03,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:03,906 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d empty. 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f empty. 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295 empty. 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513 empty. 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893 empty. 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:03,907 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:03,908 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0 empty. 2023-02-09 05:03:03,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b empty. 2023-02-09 05:03:03,908 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:03,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba empty. 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218 empty. 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7 empty. 2023-02-09 05:03:03,909 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:03,910 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:03,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 05:03:03,920 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:03,922 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b1033bc66ce46722fb08b9a7214aad8f, NAME => 'testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,922 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d07a11b131fd4699b3f627e8089605ba, NAME => 'testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,922 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 418a18b8aa0b7fa0382874badb993295, NAME => 'testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 418a18b8aa0b7fa0382874badb993295, disabling compactions & flushes 2023-02-09 05:03:03,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. after waiting 0 ms 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:03,942 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:03,942 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 418a18b8aa0b7fa0382874badb993295: Waiting for close lock at 1675918983942Disabling compacts and flushes for region at 1675918983942Disabling writes for close at 1675918983942Writing region close event to WAL at 1675918983942Closed at 1675918983942 2023-02-09 05:03:03,943 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4e8a219a1656233e0c91d1c01d50f513, NAME => 'testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b1033bc66ce46722fb08b9a7214aad8f, disabling compactions & flushes 2023-02-09 05:03:03,944 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. after waiting 0 ms 2023-02-09 05:03:03,944 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:03,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:03,945 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b1033bc66ce46722fb08b9a7214aad8f: Waiting for close lock at 1675918983944Disabling compacts and flushes for region at 1675918983944Disabling writes for close at 1675918983944Writing region close event to WAL at 1675918983945 (+1 ms)Closed at 1675918983945 2023-02-09 05:03:03,945 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 78398c7a13778a379fdf72f7b30a497d, NAME => 'testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d07a11b131fd4699b3f627e8089605ba, disabling compactions & flushes 2023-02-09 05:03:03,948 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. after waiting 0 ms 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:03,948 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:03,948 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d07a11b131fd4699b3f627e8089605ba: Waiting for close lock at 1675918983948Disabling compacts and flushes for region at 1675918983948Disabling writes for close at 1675918983948Writing region close event to WAL at 1675918983948Closed at 1675918983948 2023-02-09 05:03:03,949 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 590b9bafcafbb0c77693892a98ab28d0, NAME => 'testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4e8a219a1656233e0c91d1c01d50f513, disabling compactions & flushes 2023-02-09 05:03:03,960 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:03,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:03,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. after waiting 0 ms 2023-02-09 05:03:03,960 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:03,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:03,961 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4e8a219a1656233e0c91d1c01d50f513: Waiting for close lock at 1675918983960Disabling compacts and flushes for region at 1675918983960Disabling writes for close at 1675918983960Writing region close event to WAL at 1675918983961 (+1 ms)Closed at 1675918983961 2023-02-09 05:03:03,961 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a3a7140a550730cb4392ef22b913b30b, NAME => 'testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 78398c7a13778a379fdf72f7b30a497d, disabling compactions & flushes 2023-02-09 05:03:03,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. after waiting 0 ms 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:03,963 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:03,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 78398c7a13778a379fdf72f7b30a497d: Waiting for close lock at 1675918983963Disabling compacts and flushes for region at 1675918983963Disabling writes for close at 1675918983963Writing region close event to WAL at 1675918983963Closed at 1675918983963 2023-02-09 05:03:03,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => db2dbab00e33f92f3002cd8639a68893, NAME => 'testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 590b9bafcafbb0c77693892a98ab28d0, disabling compactions & flushes 2023-02-09 05:03:03,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:03,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:03,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. after waiting 0 ms 2023-02-09 05:03:03,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:03,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:03,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 590b9bafcafbb0c77693892a98ab28d0: Waiting for close lock at 1675918983965Disabling compacts and flushes for region at 1675918983965Disabling writes for close at 1675918983966 (+1 ms)Writing region close event to WAL at 1675918983966Closed at 1675918983966 2023-02-09 05:03:03,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c0b5ff6ddb1ad86741def9053e25c218, NAME => 'testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a3a7140a550730cb4392ef22b913b30b, disabling compactions & flushes 2023-02-09 05:03:03,979 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. after waiting 0 ms 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:03,979 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,979 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a3a7140a550730cb4392ef22b913b30b: Waiting for close lock at 1675918983979Disabling compacts and flushes for region at 1675918983979Disabling writes for close at 1675918983979Writing region close event to WAL at 1675918983979Closed at 1675918983979 2023-02-09 05:03:03,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing db2dbab00e33f92f3002cd8639a68893, disabling compactions & flushes 2023-02-09 05:03:03,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:03,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => dbb92db5a17e7445b64e2d1fee6ccef7, NAME => 'testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.tmp 2023-02-09 05:03:03,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:03,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. after waiting 0 ms 2023-02-09 05:03:03,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:03,980 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:03,980 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for db2dbab00e33f92f3002cd8639a68893: Waiting for close lock at 1675918983980Disabling compacts and flushes for region at 1675918983980Disabling writes for close at 1675918983980Writing region close event to WAL at 1675918983980Closed at 1675918983980 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c0b5ff6ddb1ad86741def9053e25c218, disabling compactions & flushes 2023-02-09 05:03:03,992 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. after waiting 0 ms 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:03,992 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:03,992 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c0b5ff6ddb1ad86741def9053e25c218: Waiting for close lock at 1675918983992Disabling compacts and flushes for region at 1675918983992Disabling writes for close at 1675918983992Writing region close event to WAL at 1675918983992Closed at 1675918983992 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing dbb92db5a17e7445b64e2d1fee6ccef7, disabling compactions & flushes 2023-02-09 05:03:03,994 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. after waiting 0 ms 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:03,994 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:03,994 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for dbb92db5a17e7445b64e2d1fee6ccef7: Waiting for close lock at 1675918983994Disabling compacts and flushes for region at 1675918983994Disabling writes for close at 1675918983994Writing region close event to WAL at 1675918983994Closed at 1675918983994 2023-02-09 05:03:03,997 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:03,998 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:03,999 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918983998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918983998"}]},"ts":"1675918983998"} 2023-02-09 05:03:04,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:04,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 05:03:04,003 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:04,003 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918984003"}]},"ts":"1675918984003"} 2023-02-09 05:03:04,004 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 05:03:04,009 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:04,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:04,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:04,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:04,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b1033bc66ce46722fb08b9a7214aad8f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d07a11b131fd4699b3f627e8089605ba, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=418a18b8aa0b7fa0382874badb993295, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8a219a1656233e0c91d1c01d50f513, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=78398c7a13778a379fdf72f7b30a497d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=590b9bafcafbb0c77693892a98ab28d0, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3a7140a550730cb4392ef22b913b30b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=db2dbab00e33f92f3002cd8639a68893, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c0b5ff6ddb1ad86741def9053e25c218, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbb92db5a17e7445b64e2d1fee6ccef7, ASSIGN}] 2023-02-09 05:03:04,019 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=418a18b8aa0b7fa0382874badb993295, ASSIGN 2023-02-09 05:03:04,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=590b9bafcafbb0c77693892a98ab28d0, ASSIGN 2023-02-09 05:03:04,020 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=78398c7a13778a379fdf72f7b30a497d, ASSIGN 2023-02-09 05:03:04,020 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d07a11b131fd4699b3f627e8089605ba, ASSIGN 2023-02-09 05:03:04,021 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=418a18b8aa0b7fa0382874badb993295, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46559,1675918982352; forceNewPlan=false, retain=false 2023-02-09 05:03:04,021 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=590b9bafcafbb0c77693892a98ab28d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:04,021 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=78398c7a13778a379fdf72f7b30a497d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46559,1675918982352; forceNewPlan=false, retain=false 2023-02-09 05:03:04,021 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d07a11b131fd4699b3f627e8089605ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46559,1675918982352; forceNewPlan=false, retain=false 2023-02-09 05:03:04,022 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3a7140a550730cb4392ef22b913b30b, ASSIGN 2023-02-09 05:03:04,022 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=db2dbab00e33f92f3002cd8639a68893, ASSIGN 2023-02-09 05:03:04,022 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b1033bc66ce46722fb08b9a7214aad8f, ASSIGN 2023-02-09 05:03:04,022 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e8a219a1656233e0c91d1c01d50f513, ASSIGN 2023-02-09 05:03:04,023 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a3a7140a550730cb4392ef22b913b30b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46559,1675918982352; forceNewPlan=false, retain=false 2023-02-09 05:03:04,023 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b1033bc66ce46722fb08b9a7214aad8f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:04,023 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=db2dbab00e33f92f3002cd8639a68893, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:04,024 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e8a219a1656233e0c91d1c01d50f513, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:04,024 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=dbb92db5a17e7445b64e2d1fee6ccef7, ASSIGN 2023-02-09 05:03:04,024 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c0b5ff6ddb1ad86741def9053e25c218, ASSIGN 2023-02-09 05:03:04,025 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=dbb92db5a17e7445b64e2d1fee6ccef7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39429,1675918982310; forceNewPlan=false, retain=false 2023-02-09 05:03:04,025 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c0b5ff6ddb1ad86741def9053e25c218, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46559,1675918982352; forceNewPlan=false, retain=false 2023-02-09 05:03:04,171 INFO [jenkins-hbase4:40289] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 05:03:04,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3a7140a550730cb4392ef22b913b30b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c0b5ff6ddb1ad86741def9053e25c218, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d07a11b131fd4699b3f627e8089605ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,176 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=418a18b8aa0b7fa0382874badb993295, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984176"}]},"ts":"1675918984176"} 2023-02-09 05:03:04,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78398c7a13778a379fdf72f7b30a497d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,176 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984176"}]},"ts":"1675918984176"} 2023-02-09 05:03:04,176 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984176"}]},"ts":"1675918984176"} 2023-02-09 05:03:04,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984176"}]},"ts":"1675918984176"} 2023-02-09 05:03:04,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984176"}]},"ts":"1675918984176"} 2023-02-09 05:03:04,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure a3a7140a550730cb4392ef22b913b30b, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:04,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure 78398c7a13778a379fdf72f7b30a497d, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:04,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 418a18b8aa0b7fa0382874badb993295, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:04,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure d07a11b131fd4699b3f627e8089605ba, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:04,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure c0b5ff6ddb1ad86741def9053e25c218, server=jenkins-hbase4.apache.org,46559,1675918982352}] 2023-02-09 05:03:04,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=db2dbab00e33f92f3002cd8639a68893, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,187 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984186"}]},"ts":"1675918984186"} 2023-02-09 05:03:04,187 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e8a219a1656233e0c91d1c01d50f513, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,187 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984187"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984187"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984187"}]},"ts":"1675918984187"} 2023-02-09 05:03:04,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=590b9bafcafbb0c77693892a98ab28d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984188"}]},"ts":"1675918984188"} 2023-02-09 05:03:04,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=dbb92db5a17e7445b64e2d1fee6ccef7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,189 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918984189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984189"}]},"ts":"1675918984189"} 2023-02-09 05:03:04,189 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b1033bc66ce46722fb08b9a7214aad8f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,189 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918984189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918984189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918984189"}]},"ts":"1675918984189"} 2023-02-09 05:03:04,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure db2dbab00e33f92f3002cd8639a68893, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:04,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 4e8a219a1656233e0c91d1c01d50f513, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:04,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=16, state=RUNNABLE; OpenRegionProcedure 590b9bafcafbb0c77693892a98ab28d0, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:04,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=20, state=RUNNABLE; OpenRegionProcedure dbb92db5a17e7445b64e2d1fee6ccef7, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:04,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure b1033bc66ce46722fb08b9a7214aad8f, server=jenkins-hbase4.apache.org,39429,1675918982310}] 2023-02-09 05:03:04,200 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:04,200 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:04,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:04,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:04,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d07a11b131fd4699b3f627e8089605ba, NAME => 'testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 05:03:04,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,338 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,339 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1 2023-02-09 05:03:04,339 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1 2023-02-09 05:03:04,340 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07a11b131fd4699b3f627e8089605ba columnFamilyName f1 2023-02-09 05:03:04,340 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(310): Store=d07a11b131fd4699b3f627e8089605ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,341 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,342 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2 2023-02-09 05:03:04,342 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2 2023-02-09 05:03:04,342 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07a11b131fd4699b3f627e8089605ba columnFamilyName f2 2023-02-09 05:03:04,343 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(310): Store=d07a11b131fd4699b3f627e8089605ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 590b9bafcafbb0c77693892a98ab28d0, NAME => 'testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:04,348 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,350 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1 2023-02-09 05:03:04,350 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1 2023-02-09 05:03:04,350 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 590b9bafcafbb0c77693892a98ab28d0 columnFamilyName f1 2023-02-09 05:03:04,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d07a11b131fd4699b3f627e8089605ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73236440, jitterRate=0.09130799770355225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d07a11b131fd4699b3f627e8089605ba: Running coprocessor pre-open hook at 1675918984337Writing region info on filesystem at 1675918984337Initializing all the Stores at 1675918984338 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984338Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984338Cleaning up temporary data from old regions at 1675918984345 (+7 ms)Cleaning up detritus from prior splits at 1675918984345Running coprocessor post-open hooks at 1675918984350 (+5 ms)Region opened successfully at 1675918984350 2023-02-09 05:03:04,351 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(310): Store=590b9bafcafbb0c77693892a98ab28d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,351 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba., pid=24, masterSystemTime=1675918984332 2023-02-09 05:03:04,352 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2 2023-02-09 05:03:04,352 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2 2023-02-09 05:03:04,353 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 590b9bafcafbb0c77693892a98ab28d0 columnFamilyName f2 2023-02-09 05:03:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:04,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:04,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:04,353 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(310): Store=590b9bafcafbb0c77693892a98ab28d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3a7140a550730cb4392ef22b913b30b, NAME => 'testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 05:03:04,354 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=d07a11b131fd4699b3f627e8089605ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,354 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984354"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984354"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984354"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984354"}]},"ts":"1675918984354"} 2023-02-09 05:03:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,355 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,357 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1 2023-02-09 05:03:04,357 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1 2023-02-09 05:03:04,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,357 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3a7140a550730cb4392ef22b913b30b columnFamilyName f1 2023-02-09 05:03:04,358 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(310): Store=a3a7140a550730cb4392ef22b913b30b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,358 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:04,359 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2 2023-02-09 05:03:04,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-09 05:03:04,359 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2 2023-02-09 05:03:04,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure d07a11b131fd4699b3f627e8089605ba, server=jenkins-hbase4.apache.org,46559,1675918982352 in 175 msec 2023-02-09 05:03:04,360 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3a7140a550730cb4392ef22b913b30b columnFamilyName f2 2023-02-09 05:03:04,361 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(310): Store=a3a7140a550730cb4392ef22b913b30b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d07a11b131fd4699b3f627e8089605ba, ASSIGN in 342 msec 2023-02-09 05:03:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 590b9bafcafbb0c77693892a98ab28d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73881108, jitterRate=0.10091429948806763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 590b9bafcafbb0c77693892a98ab28d0: Running coprocessor pre-open hook at 1675918984347Writing region info on filesystem at 1675918984347Initializing all the Stores at 1675918984348 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984348Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984348Cleaning up temporary data from old regions at 1675918984356 (+8 ms)Cleaning up detritus from prior splits at 1675918984356Running coprocessor post-open hooks at 1675918984362 (+6 ms)Region opened successfully at 1675918984362 2023-02-09 05:03:04,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0., pid=28, masterSystemTime=1675918984343 2023-02-09 05:03:04,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:04,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:04,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:04,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => db2dbab00e33f92f3002cd8639a68893, NAME => 'testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 05:03:04,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=590b9bafcafbb0c77693892a98ab28d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984365"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984365"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984365"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984365"}]},"ts":"1675918984365"} 2023-02-09 05:03:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,367 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:04,368 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1 2023-02-09 05:03:04,369 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1 2023-02-09 05:03:04,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=16 2023-02-09 05:03:04,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=16, state=SUCCESS; OpenRegionProcedure 590b9bafcafbb0c77693892a98ab28d0, server=jenkins-hbase4.apache.org,39429,1675918982310 in 173 msec 2023-02-09 05:03:04,369 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db2dbab00e33f92f3002cd8639a68893 columnFamilyName f1 2023-02-09 05:03:04,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,370 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(310): Store=db2dbab00e33f92f3002cd8639a68893/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,370 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3a7140a550730cb4392ef22b913b30b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71779942, jitterRate=0.06960448622703552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3a7140a550730cb4392ef22b913b30b: Running coprocessor pre-open hook at 1675918984354Writing region info on filesystem at 1675918984354Initializing all the Stores at 1675918984355 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984355Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984355Cleaning up temporary data from old regions at 1675918984365 (+10 ms)Cleaning up detritus from prior splits at 1675918984365Running coprocessor post-open hooks at 1675918984370 (+5 ms)Region opened successfully at 1675918984370 2023-02-09 05:03:04,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b., pid=21, masterSystemTime=1675918984332 2023-02-09 05:03:04,371 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2 2023-02-09 05:03:04,371 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2 2023-02-09 05:03:04,372 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db2dbab00e33f92f3002cd8639a68893 columnFamilyName f2 2023-02-09 05:03:04,372 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(310): Store=db2dbab00e33f92f3002cd8639a68893/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:04,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened db2dbab00e33f92f3002cd8639a68893; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61342575, jitterRate=-0.08592440187931061}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for db2dbab00e33f92f3002cd8639a68893: Running coprocessor pre-open hook at 1675918984366Writing region info on filesystem at 1675918984366Initializing all the Stores at 1675918984367 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984367Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984367Cleaning up temporary data from old regions at 1675918984374 (+7 ms)Cleaning up detritus from prior splits at 1675918984374Running coprocessor post-open hooks at 1675918984378 (+4 ms)Region opened successfully at 1675918984378 2023-02-09 05:03:04,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=590b9bafcafbb0c77693892a98ab28d0, ASSIGN in 352 msec 2023-02-09 05:03:04,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893., pid=26, masterSystemTime=1675918984343 2023-02-09 05:03:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:04,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:04,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 418a18b8aa0b7fa0382874badb993295, NAME => 'testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 05:03:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,381 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,382 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1 2023-02-09 05:03:04,383 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1 2023-02-09 05:03:04,383 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 418a18b8aa0b7fa0382874badb993295 columnFamilyName f1 2023-02-09 05:03:04,383 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(310): Store=418a18b8aa0b7fa0382874badb993295/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,383 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=a3a7140a550730cb4392ef22b913b30b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984385"}]},"ts":"1675918984385"} 2023-02-09 05:03:04,385 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2 2023-02-09 05:03:04,385 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2 2023-02-09 05:03:04,386 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 418a18b8aa0b7fa0382874badb993295 columnFamilyName f2 2023-02-09 05:03:04,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:04,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:04,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:04,386 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(310): Store=418a18b8aa0b7fa0382874badb993295/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b1033bc66ce46722fb08b9a7214aad8f, NAME => 'testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 05:03:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=db2dbab00e33f92f3002cd8639a68893, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984387"}]},"ts":"1675918984387"} 2023-02-09 05:03:04,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,389 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-09 05:03:04,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure a3a7140a550730cb4392ef22b913b30b, server=jenkins-hbase4.apache.org,46559,1675918982352 in 209 msec 2023-02-09 05:03:04,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,391 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f1 2023-02-09 05:03:04,391 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f1 2023-02-09 05:03:04,391 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1033bc66ce46722fb08b9a7214aad8f columnFamilyName f1 2023-02-09 05:03:04,392 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(310): Store=b1033bc66ce46722fb08b9a7214aad8f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,392 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3a7140a550730cb4392ef22b913b30b, ASSIGN in 372 msec 2023-02-09 05:03:04,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-09 05:03:04,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:04,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure db2dbab00e33f92f3002cd8639a68893, server=jenkins-hbase4.apache.org,39429,1675918982310 in 200 msec 2023-02-09 05:03:04,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=db2dbab00e33f92f3002cd8639a68893, ASSIGN in 376 msec 2023-02-09 05:03:04,394 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f2 2023-02-09 05:03:04,395 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f2 2023-02-09 05:03:04,395 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1033bc66ce46722fb08b9a7214aad8f columnFamilyName f2 2023-02-09 05:03:04,395 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(310): Store=b1033bc66ce46722fb08b9a7214aad8f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 418a18b8aa0b7fa0382874badb993295; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61353421, jitterRate=-0.08576278388500214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 418a18b8aa0b7fa0382874badb993295: Running coprocessor pre-open hook at 1675918984380Writing region info on filesystem at 1675918984380Initializing all the Stores at 1675918984381 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984381Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984381Cleaning up temporary data from old regions at 1675918984389 (+8 ms)Cleaning up detritus from prior splits at 1675918984389Running coprocessor post-open hooks at 1675918984399 (+10 ms)Region opened successfully at 1675918984399 2023-02-09 05:03:04,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295., pid=23, masterSystemTime=1675918984332 2023-02-09 05:03:04,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:04,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:04,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:04,402 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=418a18b8aa0b7fa0382874badb993295, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:04,402 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984402"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984402"}]},"ts":"1675918984402"} 2023-02-09 05:03:04,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c0b5ff6ddb1ad86741def9053e25c218, NAME => 'testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 05:03:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-09 05:03:04,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 418a18b8aa0b7fa0382874badb993295, server=jenkins-hbase4.apache.org,46559,1675918982352 in 224 msec 2023-02-09 05:03:04,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=418a18b8aa0b7fa0382874badb993295, ASSIGN in 389 msec 2023-02-09 05:03:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,412 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b1033bc66ce46722fb08b9a7214aad8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70827207, jitterRate=0.055407628417015076}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b1033bc66ce46722fb08b9a7214aad8f: Running coprocessor pre-open hook at 1675918984387Writing region info on filesystem at 1675918984387Initializing all the Stores at 1675918984388 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984388Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984389 (+1 ms)Cleaning up temporary data from old regions at 1675918984398 (+9 ms)Cleaning up detritus from prior splits at 1675918984398Running coprocessor post-open hooks at 1675918984412 (+14 ms)Region opened successfully at 1675918984412 2023-02-09 05:03:04,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f., pid=30, masterSystemTime=1675918984343 2023-02-09 05:03:04,413 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1 2023-02-09 05:03:04,413 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1 2023-02-09 05:03:04,414 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0b5ff6ddb1ad86741def9053e25c218 columnFamilyName f1 2023-02-09 05:03:04,415 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(310): Store=c0b5ff6ddb1ad86741def9053e25c218/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,415 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:04,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:04,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e8a219a1656233e0c91d1c01d50f513, NAME => 'testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 05:03:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,417 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2 2023-02-09 05:03:04,417 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2 2023-02-09 05:03:04,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,417 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0b5ff6ddb1ad86741def9053e25c218 columnFamilyName f2 2023-02-09 05:03:04,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b1033bc66ce46722fb08b9a7214aad8f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918984418"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984418"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984418"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984418"}]},"ts":"1675918984418"} 2023-02-09 05:03:04,418 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,418 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(310): Store=c0b5ff6ddb1ad86741def9053e25c218/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,421 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1 2023-02-09 05:03:04,421 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1 2023-02-09 05:03:04,422 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8a219a1656233e0c91d1c01d50f513 columnFamilyName f1 2023-02-09 05:03:04,422 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(310): Store=4e8a219a1656233e0c91d1c01d50f513/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,423 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-09 05:03:04,424 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure b1033bc66ce46722fb08b9a7214aad8f, server=jenkins-hbase4.apache.org,39429,1675918982310 in 224 msec 2023-02-09 05:03:04,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,425 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2 2023-02-09 05:03:04,425 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2 2023-02-09 05:03:04,425 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8a219a1656233e0c91d1c01d50f513 columnFamilyName f2 2023-02-09 05:03:04,425 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b1033bc66ce46722fb08b9a7214aad8f, ASSIGN in 407 msec 2023-02-09 05:03:04,426 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(310): Store=4e8a219a1656233e0c91d1c01d50f513/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:04,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:04,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e8a219a1656233e0c91d1c01d50f513; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68172677, jitterRate=0.015852048993110657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c0b5ff6ddb1ad86741def9053e25c218; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60145238, jitterRate=-0.10376611351966858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e8a219a1656233e0c91d1c01d50f513: Running coprocessor pre-open hook at 1675918984417Writing region info on filesystem at 1675918984417Initializing all the Stores at 1675918984418 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984418Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984418Cleaning up temporary data from old regions at 1675918984430 (+12 ms)Cleaning up detritus from prior splits at 1675918984430Running coprocessor post-open hooks at 1675918984442 (+12 ms)Region opened successfully at 1675918984442 2023-02-09 05:03:04,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c0b5ff6ddb1ad86741def9053e25c218: Running coprocessor pre-open hook at 1675918984403Writing region info on filesystem at 1675918984403Initializing all the Stores at 1675918984404 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984404Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984411 (+7 ms)Cleaning up temporary data from old regions at 1675918984422 (+11 ms)Cleaning up detritus from prior splits at 1675918984423 (+1 ms)Running coprocessor post-open hooks at 1675918984442 (+19 ms)Region opened successfully at 1675918984442 2023-02-09 05:03:04,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513., pid=27, masterSystemTime=1675918984343 2023-02-09 05:03:04,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:04,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:04,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:04,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dbb92db5a17e7445b64e2d1fee6ccef7, NAME => 'testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 05:03:04,445 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4e8a219a1656233e0c91d1c01d50f513, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,445 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984445"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984445"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984445"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984445"}]},"ts":"1675918984445"} 2023-02-09 05:03:04,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218., pid=25, masterSystemTime=1675918984332 2023-02-09 05:03:04,448 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:04,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:04,450 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=c0b5ff6ddb1ad86741def9053e25c218, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:04,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 78398c7a13778a379fdf72f7b30a497d, NAME => 'testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 05:03:04,450 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984450"}]},"ts":"1675918984450"} 2023-02-09 05:03:04,450 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f1 2023-02-09 05:03:04,450 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f1 2023-02-09 05:03:04,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,451 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb92db5a17e7445b64e2d1fee6ccef7 columnFamilyName f1 2023-02-09 05:03:04,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:04,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-09 05:03:04,451 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 4e8a219a1656233e0c91d1c01d50f513, server=jenkins-hbase4.apache.org,39429,1675918982310 in 256 msec 2023-02-09 05:03:04,452 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(310): Store=dbb92db5a17e7445b64e2d1fee6ccef7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,452 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e8a219a1656233e0c91d1c01d50f513, ASSIGN in 434 msec 2023-02-09 05:03:04,453 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f2 2023-02-09 05:03:04,453 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f2 2023-02-09 05:03:04,454 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb92db5a17e7445b64e2d1fee6ccef7 columnFamilyName f2 2023-02-09 05:03:04,454 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(310): Store=dbb92db5a17e7445b64e2d1fee6ccef7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,457 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,458 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1 2023-02-09 05:03:04,458 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1 2023-02-09 05:03:04,459 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78398c7a13778a379fdf72f7b30a497d columnFamilyName f1 2023-02-09 05:03:04,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:04,459 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(310): Store=78398c7a13778a379fdf72f7b30a497d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,459 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,462 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2 2023-02-09 05:03:04,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened dbb92db5a17e7445b64e2d1fee6ccef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62436611, jitterRate=-0.0696219950914383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,462 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2 2023-02-09 05:03:04,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for dbb92db5a17e7445b64e2d1fee6ccef7: Running coprocessor pre-open hook at 1675918984445Writing region info on filesystem at 1675918984445Initializing all the Stores at 1675918984446 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984446Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984448 (+2 ms)Cleaning up temporary data from old regions at 1675918984456 (+8 ms)Cleaning up detritus from prior splits at 1675918984457 (+1 ms)Running coprocessor post-open hooks at 1675918984462 (+5 ms)Region opened successfully at 1675918984462 2023-02-09 05:03:04,463 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78398c7a13778a379fdf72f7b30a497d columnFamilyName f2 2023-02-09 05:03:04,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7., pid=29, masterSystemTime=1675918984343 2023-02-09 05:03:04,464 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(310): Store=78398c7a13778a379fdf72f7b30a497d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:04,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-09 05:03:04,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure c0b5ff6ddb1ad86741def9053e25c218, server=jenkins-hbase4.apache.org,46559,1675918982352 in 278 msec 2023-02-09 05:03:04,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:04,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:04,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=dbb92db5a17e7445b64e2d1fee6ccef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675918984467"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984467"}]},"ts":"1675918984467"} 2023-02-09 05:03:04,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:04,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:04,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c0b5ff6ddb1ad86741def9053e25c218, ASSIGN in 448 msec 2023-02-09 05:03:04,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=20 2023-02-09 05:03:04,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=20, state=SUCCESS; OpenRegionProcedure dbb92db5a17e7445b64e2d1fee6ccef7, server=jenkins-hbase4.apache.org,39429,1675918982310 in 276 msec 2023-02-09 05:03:04,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=dbb92db5a17e7445b64e2d1fee6ccef7, ASSIGN in 456 msec 2023-02-09 05:03:04,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:04,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 78398c7a13778a379fdf72f7b30a497d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58943148, jitterRate=-0.12167865037918091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:04,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 78398c7a13778a379fdf72f7b30a497d: Running coprocessor pre-open hook at 1675918984456Writing region info on filesystem at 1675918984456Initializing all the Stores at 1675918984457 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984457Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918984457Cleaning up temporary data from old regions at 1675918984466 (+9 ms)Cleaning up detritus from prior splits at 1675918984467 (+1 ms)Running coprocessor post-open hooks at 1675918984476 (+9 ms)Region opened successfully at 1675918984476 2023-02-09 05:03:04,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d., pid=22, masterSystemTime=1675918984332 2023-02-09 05:03:04,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:04,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:04,479 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=78398c7a13778a379fdf72f7b30a497d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,479 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675918984479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918984479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918984479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918984479"}]},"ts":"1675918984479"} 2023-02-09 05:03:04,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-09 05:03:04,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure 78398c7a13778a379fdf72f7b30a497d, server=jenkins-hbase4.apache.org,46559,1675918982352 in 308 msec 2023-02-09 05:03:04,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-09 05:03:04,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=78398c7a13778a379fdf72f7b30a497d, ASSIGN in 472 msec 2023-02-09 05:03:04,492 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:04,492 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918984492"}]},"ts":"1675918984492"} 2023-02-09 05:03:04,494 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 05:03:04,496 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:04,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 603 msec 2023-02-09 05:03:04,502 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:04,502 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:04,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:04,503 INFO [Listener at localhost/44057] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 05:03:04,504 DEBUG [Listener at localhost/44057] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 05:03:04,504 INFO [Listener at localhost/44057] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:04,507 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 05:03:04,507 INFO [Listener at localhost/44057] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:04,508 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 05:03:04,508 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:04,565 DEBUG [hconnection-0x27f81525-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:04,588 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:04,597 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39429] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:04,612 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46559] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:04,767 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:04,767 INFO [Listener at localhost/44057] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:04,767 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:04,767 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:04,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675918984768 (current time:1675918984768). 2023-02-09 05:03:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:04,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] zookeeper.ReadOnlyZKClient(139): Connect 0x51336c90 to 127.0.0.1:53139 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9c6b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:04,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:04,778 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45282, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:04,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51336c90 to 127.0.0.1:53139 2023-02-09 05:03:04,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:04,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:04,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:04,783 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:04,784 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675919584784 2023-02-09 05:03:04,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:04,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 05:03:04,785 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:04,785 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:04,786 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:04,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:04,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-09 05:03:04,787 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:04,788 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675919584788 2023-02-09 05:03:04,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,803 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-09 05:03:04,803 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:04,804 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-09 05:03:04,804 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-09 05:03:04,805 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,805 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,809 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:04,809 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:04,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:04,809 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:04,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,809 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,810 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,810 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,810 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,810 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 05:03:04,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-09 05:03:04,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,811 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-09 05:03:04,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,816 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 05:03:04,816 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:04,817 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 05:03:04,817 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 05:03:04,817 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-09 05:03:04,817 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:04,817 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46559,1675918982352' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 05:03:04,818 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-09 05:03:04,818 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-09 05:03:04,818 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39429,1675918982310' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-09 05:03:04,820 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,820 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:04,820 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,820 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,820 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:04,820 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:04,821 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,821 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:04,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:04,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39429,1675918982310' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b129584[Count = 1] remaining members to acquire global barrier 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:04,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:04,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46559,1675918982352' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-09 05:03:04,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b129584[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:04,826 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-09 05:03:04,826 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,827 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:04,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,828 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:04,828 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:04,828 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:04,828 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:04,828 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. started... 2023-02-09 05:03:04,832 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 78398c7a13778a379fdf72f7b30a497d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:04,832 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:04,832 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. started... 2023-02-09 05:03:04,836 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:03:04,836 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:04,836 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:04,837 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2744): Flushing d07a11b131fd4699b3f627e8089605ba 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:03:04,836 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:04,837 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. started... 2023-02-09 05:03:04,838 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:04,838 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c0b5ff6ddb1ad86741def9053e25c218 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:03:04,839 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:04,839 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. started... 2023-02-09 05:03:04,838 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. started... 2023-02-09 05:03:04,839 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:04,839 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 590b9bafcafbb0c77693892a98ab28d0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:04,839 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:03:04,844 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:04,844 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. started... 2023-02-09 05:03:04,841 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4e8a219a1656233e0c91d1c01d50f513 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:04,845 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b1033bc66ce46722fb08b9a7214aad8f: 2023-02-09 05:03:04,845 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,846 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:04,846 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:04,846 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:04,884 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. completed. 2023-02-09 05:03:04,884 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:04,884 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:04,884 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:03:04,884 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. started... 2023-02-09 05:03:04,886 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:04,886 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:04,886 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:04,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:04,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:04,888 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for dbb92db5a17e7445b64e2d1fee6ccef7: 2023-02-09 05:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:04,890 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:04,899 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f1/aa024c2dfa7e4dee9fa9f32ff5861c08 2023-02-09 05:03:04,912 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f1/32614a16d8cd4d73a011a37ed6c6c7e3 2023-02-09 05:03:04,927 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f1/7ba4c4f1006b4a4ab85315693ab54753 2023-02-09 05:03:04,927 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f1/cdf90bf91c1e4b50b53a7b2c23b679b1 2023-02-09 05:03:04,940 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f1/02403ceea8294c66a7960de55d517044 2023-02-09 05:03:04,975 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. completed. 2023-02-09 05:03:04,975 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:04,975 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:04,975 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:03:04,975 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. started... 2023-02-09 05:03:04,976 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegion(2744): Flushing db2dbab00e33f92f3002cd8639a68893 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:04,980 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f2/2311d5c9da9b45e99e5097d5eaa94147 2023-02-09 05:03:04,989 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:04,990 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f1/aa024c2dfa7e4dee9fa9f32ff5861c08 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/aa024c2dfa7e4dee9fa9f32ff5861c08 2023-02-09 05:03:05,000 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f2/d7f1e6f7206c4591a5f42ff6d3873a81 2023-02-09 05:03:05,004 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f2/b912d9a83bc3441e9702a0c6ea3d9e9f 2023-02-09 05:03:05,011 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f2/222811c5b9ee406ab5ed2f7d0b9d45a7 2023-02-09 05:03:05,013 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/aa024c2dfa7e4dee9fa9f32ff5861c08, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,025 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f2/2311d5c9da9b45e99e5097d5eaa94147 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/2311d5c9da9b45e99e5097d5eaa94147 2023-02-09 05:03:05,029 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f1/7ba4c4f1006b4a4ab85315693ab54753 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/7ba4c4f1006b4a4ab85315693ab54753 2023-02-09 05:03:05,036 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f1/cdf90bf91c1e4b50b53a7b2c23b679b1 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/cdf90bf91c1e4b50b53a7b2c23b679b1 2023-02-09 05:03:05,039 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/2311d5c9da9b45e99e5097d5eaa94147, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,040 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 78398c7a13778a379fdf72f7b30a497d in 208ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 78398c7a13778a379fdf72f7b30a497d: 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/aa024c2dfa7e4dee9fa9f32ff5861c08] hfiles 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/aa024c2dfa7e4dee9fa9f32ff5861c08 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/2311d5c9da9b45e99e5097d5eaa94147] hfiles 2023-02-09 05:03:05,041 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/2311d5c9da9b45e99e5097d5eaa94147 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,054 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/7ba4c4f1006b4a4ab85315693ab54753, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,055 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f1/32614a16d8cd4d73a011a37ed6c6c7e3 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/32614a16d8cd4d73a011a37ed6c6c7e3 2023-02-09 05:03:05,056 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f2/d7f1e6f7206c4591a5f42ff6d3873a81 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/d7f1e6f7206c4591a5f42ff6d3873a81 2023-02-09 05:03:05,056 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/cdf90bf91c1e4b50b53a7b2c23b679b1, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:05,065 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f2/b912d9a83bc3441e9702a0c6ea3d9e9f as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/b912d9a83bc3441e9702a0c6ea3d9e9f 2023-02-09 05:03:05,069 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/d7f1e6f7206c4591a5f42ff6d3873a81, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,070 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4e8a219a1656233e0c91d1c01d50f513 in 230ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4e8a219a1656233e0c91d1c01d50f513: 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/7ba4c4f1006b4a4ab85315693ab54753] hfiles 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/7ba4c4f1006b4a4ab85315693ab54753 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/d7f1e6f7206c4591a5f42ff6d3873a81] hfiles 2023-02-09 05:03:05,070 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/d7f1e6f7206c4591a5f42ff6d3873a81 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,079 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/32614a16d8cd4d73a011a37ed6c6c7e3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:05,080 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f2/222811c5b9ee406ab5ed2f7d0b9d45a7 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/222811c5b9ee406ab5ed2f7d0b9d45a7 2023-02-09 05:03:05,088 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:05,088 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:05,088 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:05,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:05,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:05,090 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 05:03:05,091 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/b912d9a83bc3441e9702a0c6ea3d9e9f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:05,091 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d07a11b131fd4699b3f627e8089605ba in 254ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,091 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d07a11b131fd4699b3f627e8089605ba: 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/cdf90bf91c1e4b50b53a7b2c23b679b1] hfiles 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/cdf90bf91c1e4b50b53a7b2c23b679b1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/b912d9a83bc3441e9702a0c6ea3d9e9f] hfiles 2023-02-09 05:03:05,092 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/b912d9a83bc3441e9702a0c6ea3d9e9f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,095 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/222811c5b9ee406ab5ed2f7d0b9d45a7, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:05,095 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c0b5ff6ddb1ad86741def9053e25c218 in 257ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c0b5ff6ddb1ad86741def9053e25c218: 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/32614a16d8cd4d73a011a37ed6c6c7e3] hfiles 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/32614a16d8cd4d73a011a37ed6c6c7e3 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/222811c5b9ee406ab5ed2f7d0b9d45a7] hfiles 2023-02-09 05:03:05,096 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/222811c5b9ee406ab5ed2f7d0b9d45a7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,108 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. completed. 2023-02-09 05:03:05,110 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:05,110 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:05,111 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. started... 2023-02-09 05:03:05,111 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2744): Flushing a3a7140a550730cb4392ef22b913b30b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:05,111 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:03:05,118 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. completed. 2023-02-09 05:03:05,118 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:05,118 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:03:05,130 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. completed. 2023-02-09 05:03:05,131 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:05,131 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:05,131 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. started... 2023-02-09 05:03:05,131 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 418a18b8aa0b7fa0382874badb993295 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:05,131 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:03:05,136 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. completed. 2023-02-09 05:03:05,136 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:05,136 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:03:05,144 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f1/d38cfe15e36d4defaf576f654546e2db 2023-02-09 05:03:05,152 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f1/64789797f5ac4c10bdc40ef7183f5d40 2023-02-09 05:03:05,178 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f2/b012e67ac95d496fb697bec3ebfaac1d 2023-02-09 05:03:05,184 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f1/64789797f5ac4c10bdc40ef7183f5d40 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/64789797f5ac4c10bdc40ef7183f5d40 2023-02-09 05:03:05,191 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/64789797f5ac4c10bdc40ef7183f5d40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,192 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f2/b012e67ac95d496fb697bec3ebfaac1d as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/b012e67ac95d496fb697bec3ebfaac1d 2023-02-09 05:03:05,197 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/b012e67ac95d496fb697bec3ebfaac1d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,198 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 418a18b8aa0b7fa0382874badb993295 in 67ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 418a18b8aa0b7fa0382874badb993295: 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/64789797f5ac4c10bdc40ef7183f5d40] hfiles 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/64789797f5ac4c10bdc40ef7183f5d40 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/b012e67ac95d496fb697bec3ebfaac1d] hfiles 2023-02-09 05:03:05,198 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/b012e67ac95d496fb697bec3ebfaac1d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,205 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. completed. 2023-02-09 05:03:05,205 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:05,205 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:03:05,390 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:05,390 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:05,391 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:05,392 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 05:03:05,431 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f2/61703ce2d2eb44898b25a06d1045ae0d 2023-02-09 05:03:05,445 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f1/02403ceea8294c66a7960de55d517044 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/02403ceea8294c66a7960de55d517044 2023-02-09 05:03:05,451 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/02403ceea8294c66a7960de55d517044, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,452 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f2/61703ce2d2eb44898b25a06d1045ae0d as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/61703ce2d2eb44898b25a06d1045ae0d 2023-02-09 05:03:05,455 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f1/606f25136141412ca4e599f12df3b0f7 2023-02-09 05:03:05,457 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/61703ce2d2eb44898b25a06d1045ae0d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,458 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 590b9bafcafbb0c77693892a98ab28d0 in 619ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,458 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 590b9bafcafbb0c77693892a98ab28d0: 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/02403ceea8294c66a7960de55d517044] hfiles 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/02403ceea8294c66a7960de55d517044 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/61703ce2d2eb44898b25a06d1045ae0d] hfiles 2023-02-09 05:03:05,459 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/61703ce2d2eb44898b25a06d1045ae0d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,652 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. completed. 2023-02-09 05:03:05,652 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:05,652 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:03:05,655 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f2/c9789205756a43ada7aa933555634c81 2023-02-09 05:03:05,663 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f2/e723ae514fe34728bcd688e1618a20c1 2023-02-09 05:03:05,663 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f1/d38cfe15e36d4defaf576f654546e2db as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/d38cfe15e36d4defaf576f654546e2db 2023-02-09 05:03:05,669 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f1/606f25136141412ca4e599f12df3b0f7 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/606f25136141412ca4e599f12df3b0f7 2023-02-09 05:03:05,669 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/d38cfe15e36d4defaf576f654546e2db, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,670 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f2/c9789205756a43ada7aa933555634c81 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/c9789205756a43ada7aa933555634c81 2023-02-09 05:03:05,674 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/606f25136141412ca4e599f12df3b0f7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,675 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f2/e723ae514fe34728bcd688e1618a20c1 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/e723ae514fe34728bcd688e1618a20c1 2023-02-09 05:03:05,675 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/c9789205756a43ada7aa933555634c81, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,677 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a3a7140a550730cb4392ef22b913b30b in 566ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for a3a7140a550730cb4392ef22b913b30b: 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/d38cfe15e36d4defaf576f654546e2db] hfiles 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/d38cfe15e36d4defaf576f654546e2db for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/c9789205756a43ada7aa933555634c81] hfiles 2023-02-09 05:03:05,678 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/c9789205756a43ada7aa933555634c81 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,685 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/e723ae514fe34728bcd688e1618a20c1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:05,686 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for db2dbab00e33f92f3002cd8639a68893 in 710ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for db2dbab00e33f92f3002cd8639a68893: 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/606f25136141412ca4e599f12df3b0f7] hfiles 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/606f25136141412ca4e599f12df3b0f7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,686 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/e723ae514fe34728bcd688e1618a20c1] hfiles 2023-02-09 05:03:05,687 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/e723ae514fe34728bcd688e1618a20c1 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,696 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. completed. 2023-02-09 05:03:05,696 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:03:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:03:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 05:03:05,696 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,46559,1675918982352' in zk 2023-02-09 05:03:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 05:03:05,698 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:05,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:05,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:05,698 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 05:03:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:05,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,46559,1675918982352': 2023-02-09 05:03:05,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46559,1675918982352' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 05:03:05,703 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. completed. 2023-02-09 05:03:05,703 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:03:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:03:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-09 05:03:05,703 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,39429,1675918982310' in zk 2023-02-09 05:03:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-09 05:03:05,705 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:05,705 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-09 05:03:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:05,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,39429,1675918982310': 2023-02-09 05:03:05,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39429,1675918982310' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:05,709 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-09 05:03:05,709 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:05,709 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:05,709 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,709 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:05,711 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:05,711 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:05,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:05,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:05,712 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,712 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,714 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:05,714 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:05,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:05,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:05,721 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:05,722 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:05,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,722 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:05,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,722 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:05,723 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:05,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:05,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:05,723 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,723 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,793 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-09 05:03:05,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,793 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:05,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675918984784Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675918985722 (+938 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675918985723 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675918985739 (+16 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675918985751 (+12 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675918985793 (+42 ms) 2023-02-09 05:03:05,795 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:05,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0100 sec 2023-02-09 05:03:05,893 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:05,893 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:05,893 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:05,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:05,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:05,895 INFO [Listener at localhost/44057] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:05,895 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:05,895 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:05,900 INFO [Listener at localhost/44057] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:05,908 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:05,954 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39429] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:05,966 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46559] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,051 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:06,055 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:06,055 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:06,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:06,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 05:03:06,061 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 05:03:06,061 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:06,062 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 05:03:06,062 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 05:03:06,062 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,062 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,064 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:06,064 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:06,064 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:06,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,064 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,065 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,065 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:03:06,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:03:06,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:03:06,068 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:03:06,068 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:03:06,068 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:06,068 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:03:06,069 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:03:06,072 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,072 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. started... 2023-02-09 05:03:06,072 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e8a219a1656233e0c91d1c01d50f513 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,072 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,073 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,073 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. started... 2023-02-09 05:03:06,073 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. started... 2023-02-09 05:03:06,073 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 590b9bafcafbb0c77693892a98ab28d0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,073 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 78398c7a13778a379fdf72f7b30a497d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,076 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:03:06,076 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:06,076 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,076 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. started... 2023-02-09 05:03:06,076 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b1033bc66ce46722fb08b9a7214aad8f: 2023-02-09 05:03:06,076 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,079 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,080 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:06,079 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. started... 2023-02-09 05:03:06,079 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for dbb92db5a17e7445b64e2d1fee6ccef7: 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. started... 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. started... 2023-02-09 05:03:06,080 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,081 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d07a11b131fd4699b3f627e8089605ba 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:03:06,081 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. started... 2023-02-09 05:03:06,081 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing db2dbab00e33f92f3002cd8639a68893 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,081 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c0b5ff6ddb1ad86741def9053e25c218 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:03:06,085 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:03:06,085 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:03:06,116 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f1/b9353073be69491582df447ae56c06f8 2023-02-09 05:03:06,152 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f1/476a4c5dffa2467da660c784def1492f 2023-02-09 05:03:06,154 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f1/0284c37907614f0b90e1ad6bf31ba9df 2023-02-09 05:03:06,154 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f1/58fedf52475c4edd9e6fa90a68eccb60 2023-02-09 05:03:06,156 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f1/3e130a2086f940fca54393f0c16f7004 2023-02-09 05:03:06,157 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f1/0075aa1133744ee2b64cd390dd92f0f5 2023-02-09 05:03:06,161 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f2/f191b7ff5bde4ee2bde1dd5d9f9ea6c1 2023-02-09 05:03:06,169 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f1/b9353073be69491582df447ae56c06f8 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/b9353073be69491582df447ae56c06f8 2023-02-09 05:03:06,176 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/b9353073be69491582df447ae56c06f8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,177 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/.tmp/f2/f191b7ff5bde4ee2bde1dd5d9f9ea6c1 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/f191b7ff5bde4ee2bde1dd5d9f9ea6c1 2023-02-09 05:03:06,206 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/f191b7ff5bde4ee2bde1dd5d9f9ea6c1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,207 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4e8a219a1656233e0c91d1c01d50f513 in 135ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,207 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e8a219a1656233e0c91d1c01d50f513: 2023-02-09 05:03:06,207 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,207 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:03:06,213 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f2/5d89aa58644349f4a739ec87a5bc437f 2023-02-09 05:03:06,216 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f2/13ef90d797264a0b84d54033e4de6cf5 2023-02-09 05:03:06,216 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f2/ca4b55430df24c4f84a7b763cd1b216e 2023-02-09 05:03:06,216 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f2/4ef2f62b1a774a8da4f7b558118408bd 2023-02-09 05:03:06,222 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f1/3e130a2086f940fca54393f0c16f7004 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/3e130a2086f940fca54393f0c16f7004 2023-02-09 05:03:06,225 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f1/0075aa1133744ee2b64cd390dd92f0f5 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/0075aa1133744ee2b64cd390dd92f0f5 2023-02-09 05:03:06,226 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f1/0284c37907614f0b90e1ad6bf31ba9df as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/0284c37907614f0b90e1ad6bf31ba9df 2023-02-09 05:03:06,228 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/3e130a2086f940fca54393f0c16f7004, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,230 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/.tmp/f2/13ef90d797264a0b84d54033e4de6cf5 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/13ef90d797264a0b84d54033e4de6cf5 2023-02-09 05:03:06,230 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f1/476a4c5dffa2467da660c784def1492f as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/476a4c5dffa2467da660c784def1492f 2023-02-09 05:03:06,233 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/0284c37907614f0b90e1ad6bf31ba9df, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,233 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/0075aa1133744ee2b64cd390dd92f0f5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:06,237 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/.tmp/f2/ca4b55430df24c4f84a7b763cd1b216e as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/ca4b55430df24c4f84a7b763cd1b216e 2023-02-09 05:03:06,237 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f2/e2a3fa836e264e8792ce59774c863b8a 2023-02-09 05:03:06,237 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/.tmp/f2/5d89aa58644349f4a739ec87a5bc437f as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/5d89aa58644349f4a739ec87a5bc437f 2023-02-09 05:03:06,240 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/13ef90d797264a0b84d54033e4de6cf5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,242 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for db2dbab00e33f92f3002cd8639a68893 in 160ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,242 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for db2dbab00e33f92f3002cd8639a68893: 2023-02-09 05:03:06,242 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,242 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:03:06,243 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/476a4c5dffa2467da660c784def1492f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:06,244 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/.tmp/f2/4ef2f62b1a774a8da4f7b558118408bd as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/4ef2f62b1a774a8da4f7b558118408bd 2023-02-09 05:03:06,245 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/ca4b55430df24c4f84a7b763cd1b216e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,246 INFO [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 590b9bafcafbb0c77693892a98ab28d0 in 173ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,246 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 590b9bafcafbb0c77693892a98ab28d0: 2023-02-09 05:03:06,246 DEBUG [rs(jenkins-hbase4.apache.org,39429,1675918982310)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,246 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:03:06,246 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:03:06,247 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,247 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:03:06,247 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39429,1675918982310' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:03:06,247 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f1/58fedf52475c4edd9e6fa90a68eccb60 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/58fedf52475c4edd9e6fa90a68eccb60 2023-02-09 05:03:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,249 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,249 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/5d89aa58644349f4a739ec87a5bc437f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:06,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:06,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:06,250 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d07a11b131fd4699b3f627e8089605ba in 170ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:06,250 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d07a11b131fd4699b3f627e8089605ba: 2023-02-09 05:03:06,250 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,250 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,250 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. started... 2023-02-09 05:03:06,250 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:03:06,250 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a3a7140a550730cb4392ef22b913b30b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:06,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39429,1675918982310' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 05:03:06,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f2d143e[Count = 1] remaining members to acquire global barrier 2023-02-09 05:03:06,256 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/58fedf52475c4edd9e6fa90a68eccb60, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,257 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/.tmp/f2/e2a3fa836e264e8792ce59774c863b8a as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/e2a3fa836e264e8792ce59774c863b8a 2023-02-09 05:03:06,257 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/4ef2f62b1a774a8da4f7b558118408bd, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:06,258 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c0b5ff6ddb1ad86741def9053e25c218 in 178ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,258 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c0b5ff6ddb1ad86741def9053e25c218: 2023-02-09 05:03:06,258 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,258 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,258 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:03:06,258 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. started... 2023-02-09 05:03:06,258 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 418a18b8aa0b7fa0382874badb993295 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:06,266 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/e2a3fa836e264e8792ce59774c863b8a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,267 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 78398c7a13778a379fdf72f7b30a497d in 194ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,267 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 78398c7a13778a379fdf72f7b30a497d: 2023-02-09 05:03:06,267 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,268 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:03:06,279 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f1/b59d7994b2d04a128d91899ec790ef8f 2023-02-09 05:03:06,283 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f1/01fa4ddfa2ef4af0ab49f4717732fda3 2023-02-09 05:03:06,309 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f2/cfe066d1df2a46a9b33eb8499f61925e 2023-02-09 05:03:06,315 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f1/01fa4ddfa2ef4af0ab49f4717732fda3 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/01fa4ddfa2ef4af0ab49f4717732fda3 2023-02-09 05:03:06,320 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/01fa4ddfa2ef4af0ab49f4717732fda3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,321 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/.tmp/f2/cfe066d1df2a46a9b33eb8499f61925e as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/cfe066d1df2a46a9b33eb8499f61925e 2023-02-09 05:03:06,326 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/cfe066d1df2a46a9b33eb8499f61925e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,327 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 418a18b8aa0b7fa0382874badb993295 in 68ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,327 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 418a18b8aa0b7fa0382874badb993295: 2023-02-09 05:03:06,327 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,327 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:03:06,705 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f2/f4c3263ffd874a4e974305f8f1b0f565 2023-02-09 05:03:06,710 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f1/b59d7994b2d04a128d91899ec790ef8f as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/b59d7994b2d04a128d91899ec790ef8f 2023-02-09 05:03:06,715 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/b59d7994b2d04a128d91899ec790ef8f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,716 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/.tmp/f2/f4c3263ffd874a4e974305f8f1b0f565 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/f4c3263ffd874a4e974305f8f1b0f565 2023-02-09 05:03:06,721 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/f4c3263ffd874a4e974305f8f1b0f565, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:06,721 INFO [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a3a7140a550730cb4392ef22b913b30b in 471ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:06,721 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a3a7140a550730cb4392ef22b913b30b: 2023-02-09 05:03:06,721 DEBUG [rs(jenkins-hbase4.apache.org,46559,1675918982352)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:03:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:03:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:03:06,722 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46559,1675918982352' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:03:06,723 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,724 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:06,724 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,724 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:06,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46559,1675918982352' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 05:03:06,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f2d143e[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:06,726 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 05:03:06,726 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:03:06,730 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39429,1675918982310' in zk 2023-02-09 05:03:06,730 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,46559,1675918982352' in zk 2023-02-09 05:03:06,731 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,731 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:06,732 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:03:06,732 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,732 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:06,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:06,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:06,732 DEBUG [member: 'jenkins-hbase4.apache.org,39429,1675918982310' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:03:06,733 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:06,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:06,734 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:03:06,734 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:06,734 DEBUG [member: 'jenkins-hbase4.apache.org,46559,1675918982352' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:03:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:06,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,39429,1675918982310': 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39429,1675918982310' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,46559,1675918982352': 2023-02-09 05:03:06,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46559,1675918982352' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 05:03:06,740 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 05:03:06,740 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:06,740 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:06,740 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 05:03:06,740 INFO [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:06,742 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:06,742 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,742 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:06,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:06,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:06,743 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,743 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:06,745 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:06,745 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:06,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 05:03:06,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,750 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,749 DEBUG [(jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:06,749 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:06,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:06,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:06,750 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:06,751 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:06,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:06,851 DEBUG [Listener at localhost/44057] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:06,851 INFO [Listener at localhost/44057] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:06,851 INFO [Listener at localhost/44057] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:06,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40289] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:06,853 INFO [Listener at localhost/44057] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:06,853 DEBUG [Listener at localhost/44057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x541141ad to 127.0.0.1:53139 2023-02-09 05:03:06,854 DEBUG [Listener at localhost/44057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:06,854 DEBUG [Listener at localhost/44057] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:06,854 DEBUG [Listener at localhost/44057] util.JVMClusterUtil(257): Found active master hash=502735275, stopped=false 2023-02-09 05:03:06,854 INFO [Listener at localhost/44057] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:06,856 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:06,856 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:06,856 INFO [Listener at localhost/44057] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:06,856 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:06,856 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:06,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:06,857 DEBUG [Listener at localhost/44057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1befa02c to 127.0.0.1:53139 2023-02-09 05:03:06,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:06,857 DEBUG [Listener at localhost/44057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:06,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:06,858 INFO [Listener at localhost/44057] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39429,1675918982310' ***** 2023-02-09 05:03:06,858 INFO [Listener at localhost/44057] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:06,858 INFO [Listener at localhost/44057] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46559,1675918982352' ***** 2023-02-09 05:03:06,858 INFO [Listener at localhost/44057] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:06,858 INFO [RS:0;jenkins-hbase4:39429] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:06,858 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:06,858 INFO [RS:0;jenkins-hbase4:39429] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:06,859 INFO [RS:0;jenkins-hbase4:39429] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:06,859 INFO [RS:1;jenkins-hbase4:46559] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:06,859 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:06,860 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:06,860 INFO [RS:1;jenkins-hbase4:46559] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:06,860 INFO [RS:1;jenkins-hbase4:46559] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:06,860 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for 08358f8db3ba23969606f5eb18aeb802 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e8a219a1656233e0c91d1c01d50f513, disabling compactions & flushes 2023-02-09 05:03:06,861 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:06,861 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:06,861 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:06,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,861 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,861 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(3304): Received CLOSE for db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:06,861 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:06,861 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 78398c7a13778a379fdf72f7b30a497d, disabling compactions & flushes 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. after waiting 0 ms 2023-02-09 05:03:06,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,861 DEBUG [RS:0;jenkins-hbase4:39429] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d116a09 to 127.0.0.1:53139 2023-02-09 05:03:06,861 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:06,861 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:06,861 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,862 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:06,862 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 05:03:06,862 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:06,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. after waiting 0 ms 2023-02-09 05:03:06,862 DEBUG [RS:1;jenkins-hbase4:46559] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f537c5b to 127.0.0.1:53139 2023-02-09 05:03:06,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,862 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1479): Online Regions={4e8a219a1656233e0c91d1c01d50f513=testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513., 08358f8db3ba23969606f5eb18aeb802=hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802., 590b9bafcafbb0c77693892a98ab28d0=testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0., b1033bc66ce46722fb08b9a7214aad8f=testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f., dbb92db5a17e7445b64e2d1fee6ccef7=testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7., db2dbab00e33f92f3002cd8639a68893=testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.} 2023-02-09 05:03:06,863 DEBUG [RS:1;jenkins-hbase4:46559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:06,864 INFO [RS:1;jenkins-hbase4:46559] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:06,864 INFO [RS:1;jenkins-hbase4:46559] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:06,864 INFO [RS:1;jenkins-hbase4:46559] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:06,864 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:06,864 DEBUG [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1505): Waiting on 08358f8db3ba23969606f5eb18aeb802, 4e8a219a1656233e0c91d1c01d50f513, 590b9bafcafbb0c77693892a98ab28d0, b1033bc66ce46722fb08b9a7214aad8f, db2dbab00e33f92f3002cd8639a68893, dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:06,865 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-09 05:03:06,866 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1479): Online Regions={78398c7a13778a379fdf72f7b30a497d=testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d., d07a11b131fd4699b3f627e8089605ba=testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba., 1588230740=hbase:meta,,1.1588230740, c0b5ff6ddb1ad86741def9053e25c218=testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218., a3a7140a550730cb4392ef22b913b30b=testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b., 418a18b8aa0b7fa0382874badb993295=testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.} 2023-02-09 05:03:06,866 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:06,866 DEBUG [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1505): Waiting on 1588230740, 418a18b8aa0b7fa0382874badb993295, 78398c7a13778a379fdf72f7b30a497d, a3a7140a550730cb4392ef22b913b30b, c0b5ff6ddb1ad86741def9053e25c218, d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:06,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:06,867 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:06,868 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:06,869 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:06,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-09 05:03:06,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e8a219a1656233e0c91d1c01d50f513: Waiting for close lock at 1675918986861Running coprocessor pre-close hooks at 1675918986861Disabling compacts and flushes for region at 1675918986861Disabling writes for close at 1675918986861Writing region close event to WAL at 1675918986869 (+8 ms)Running coprocessor post-close hooks at 1675918986875 (+6 ms)Closed at 1675918986876 (+1 ms) 2023-02-09 05:03:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:06,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 78398c7a13778a379fdf72f7b30a497d: Waiting for close lock at 1675918986861Running coprocessor pre-close hooks at 1675918986861Disabling compacts and flushes for region at 1675918986861Disabling writes for close at 1675918986862 (+1 ms)Writing region close event to WAL at 1675918986872 (+10 ms)Running coprocessor post-close hooks at 1675918986876 (+4 ms)Closed at 1675918986880 (+4 ms) 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08358f8db3ba23969606f5eb18aeb802, disabling compactions & flushes 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:06,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d07a11b131fd4699b3f627e8089605ba, disabling compactions & flushes 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:06,880 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. after waiting 0 ms 2023-02-09 05:03:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. after waiting 0 ms 2023-02-09 05:03:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:06,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 08358f8db3ba23969606f5eb18aeb802 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:06,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/.tmp/info/ba81b6d4cd7547c7a3bfbd2ee492e10d 2023-02-09 05:03:06,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d07a11b131fd4699b3f627e8089605ba: Waiting for close lock at 1675918986880Running coprocessor pre-close hooks at 1675918986880Disabling compacts and flushes for region at 1675918986880Disabling writes for close at 1675918986881 (+1 ms)Writing region close event to WAL at 1675918986887 (+6 ms)Running coprocessor post-close hooks at 1675918986899 (+12 ms)Closed at 1675918986905 (+6 ms) 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c0b5ff6ddb1ad86741def9053e25c218, disabling compactions & flushes 2023-02-09 05:03:06,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. after waiting 0 ms 2023-02-09 05:03:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/.tmp/info/6a70aa6116a54fbe955a4fecf9c8dbea 2023-02-09 05:03:06,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/.tmp/info/6a70aa6116a54fbe955a4fecf9c8dbea as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/info/6a70aa6116a54fbe955a4fecf9c8dbea 2023-02-09 05:03:06,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/info/6a70aa6116a54fbe955a4fecf9c8dbea, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:06,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 08358f8db3ba23969606f5eb18aeb802 in 46ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:06,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 05:03:06,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/.tmp/table/c28a0b6a678a40d38c53b71a50ec5732 2023-02-09 05:03:06,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c0b5ff6ddb1ad86741def9053e25c218: Waiting for close lock at 1675918986905Running coprocessor pre-close hooks at 1675918986905Disabling compacts and flushes for region at 1675918986905Disabling writes for close at 1675918986905Writing region close event to WAL at 1675918986924 (+19 ms)Running coprocessor post-close hooks at 1675918986930 (+6 ms)Closed at 1675918986931 (+1 ms) 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3a7140a550730cb4392ef22b913b30b, disabling compactions & flushes 2023-02-09 05:03:06,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. after waiting 0 ms 2023-02-09 05:03:06,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/namespace/08358f8db3ba23969606f5eb18aeb802/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:06,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08358f8db3ba23969606f5eb18aeb802: Waiting for close lock at 1675918986880Running coprocessor pre-close hooks at 1675918986880Disabling compacts and flushes for region at 1675918986880Disabling writes for close at 1675918986881 (+1 ms)Obtaining lock to block concurrent updates at 1675918986881Preparing flush snapshotting stores in 08358f8db3ba23969606f5eb18aeb802 at 1675918986881Finished memstore snapshotting hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675918986881Flushing stores of hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. at 1675918986883 (+2 ms)Flushing 08358f8db3ba23969606f5eb18aeb802/info: creating writer at 1675918986883Flushing 08358f8db3ba23969606f5eb18aeb802/info: appending metadata at 1675918986889 (+6 ms)Flushing 08358f8db3ba23969606f5eb18aeb802/info: closing flushed file at 1675918986889Flushing 08358f8db3ba23969606f5eb18aeb802/info: reopening flushed file at 1675918986913 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 08358f8db3ba23969606f5eb18aeb802 in 46ms, sequenceid=6, compaction requested=false at 1675918986927 (+14 ms)Writing region close event to WAL at 1675918986928 (+1 ms)Running coprocessor post-close hooks at 1675918986932 (+4 ms)Closed at 1675918986933 (+1 ms) 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675918982998.08358f8db3ba23969606f5eb18aeb802. 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 590b9bafcafbb0c77693892a98ab28d0, disabling compactions & flushes 2023-02-09 05:03:06,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. after waiting 0 ms 2023-02-09 05:03:06,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,937 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/.tmp/info/ba81b6d4cd7547c7a3bfbd2ee492e10d as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/info/ba81b6d4cd7547c7a3bfbd2ee492e10d 2023-02-09 05:03:06,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3a7140a550730cb4392ef22b913b30b: Waiting for close lock at 1675918986931Running coprocessor pre-close hooks at 1675918986931Disabling compacts and flushes for region at 1675918986931Disabling writes for close at 1675918986931Writing region close event to WAL at 1675918986933 (+2 ms)Running coprocessor post-close hooks at 1675918986938 (+5 ms)Closed at 1675918986939 (+1 ms) 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 418a18b8aa0b7fa0382874badb993295, disabling compactions & flushes 2023-02-09 05:03:06,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. after waiting 0 ms 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 590b9bafcafbb0c77693892a98ab28d0: Waiting for close lock at 1675918986933Running coprocessor pre-close hooks at 1675918986933Disabling compacts and flushes for region at 1675918986933Disabling writes for close at 1675918986933Writing region close event to WAL at 1675918986935 (+2 ms)Running coprocessor post-close hooks at 1675918986940 (+5 ms)Closed at 1675918986940 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b1033bc66ce46722fb08b9a7214aad8f, disabling compactions & flushes 2023-02-09 05:03:06,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. after waiting 0 ms 2023-02-09 05:03:06,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/info/ba81b6d4cd7547c7a3bfbd2ee492e10d, entries=110, sequenceid=32, filesize=18.7 K 2023-02-09 05:03:06,945 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/.tmp/table/c28a0b6a678a40d38c53b71a50ec5732 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/table/c28a0b6a678a40d38c53b71a50ec5732 2023-02-09 05:03:06,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:03:06,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b1033bc66ce46722fb08b9a7214aad8f: Waiting for close lock at 1675918986941Running coprocessor pre-close hooks at 1675918986941Disabling compacts and flushes for region at 1675918986941Disabling writes for close at 1675918986941Writing region close event to WAL at 1675918986944 (+3 ms)Running coprocessor post-close hooks at 1675918986948 (+4 ms)Closed at 1675918986950 (+2 ms) 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing dbb92db5a17e7445b64e2d1fee6ccef7, disabling compactions & flushes 2023-02-09 05:03:06,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. after waiting 0 ms 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 418a18b8aa0b7fa0382874badb993295: Waiting for close lock at 1675918986939Running coprocessor pre-close hooks at 1675918986939Disabling compacts and flushes for region at 1675918986939Disabling writes for close at 1675918986939Writing region close event to WAL at 1675918986944 (+5 ms)Running coprocessor post-close hooks at 1675918986950 (+6 ms)Closed at 1675918986950 2023-02-09 05:03:06,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:06,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/table/c28a0b6a678a40d38c53b71a50ec5732, entries=4, sequenceid=32, filesize=4.8 K 2023-02-09 05:03:06,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=32, compaction requested=false 2023-02-09 05:03:06,953 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 05:03:06,954 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:06,954 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:06,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:03:06,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for dbb92db5a17e7445b64e2d1fee6ccef7: Waiting for close lock at 1675918986950Running coprocessor pre-close hooks at 1675918986950Disabling compacts and flushes for region at 1675918986950Disabling writes for close at 1675918986950Writing region close event to WAL at 1675918986951 (+1 ms)Running coprocessor post-close hooks at 1675918986961 (+10 ms)Closed at 1675918986961 2023-02-09 05:03:06,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:06,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing db2dbab00e33f92f3002cd8639a68893, disabling compactions & flushes 2023-02-09 05:03:06,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. after waiting 0 ms 2023-02-09 05:03:06,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-09 05:03:06,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:06,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:06,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918986866Running coprocessor pre-close hooks at 1675918986866Disabling compacts and flushes for region at 1675918986866Disabling writes for close at 1675918986869 (+3 ms)Obtaining lock to block concurrent updates at 1675918986870 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675918986870Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675918986872 (+2 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675918986872Flushing 1588230740/info: creating writer at 1675918986872Flushing 1588230740/info: appending metadata at 1675918986875 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675918986875Flushing 1588230740/table: creating writer at 1675918986903 (+28 ms)Flushing 1588230740/table: appending metadata at 1675918986912 (+9 ms)Flushing 1588230740/table: closing flushed file at 1675918986912Flushing 1588230740/info: reopening flushed file at 1675918986938 (+26 ms)Flushing 1588230740/table: reopening flushed file at 1675918986945 (+7 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=32, compaction requested=false at 1675918986953 (+8 ms)Writing region close event to WAL at 1675918986961 (+8 ms)Running coprocessor post-close hooks at 1675918986965 (+4 ms)Closed at 1675918986965 2023-02-09 05:03:06,965 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:06,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:06,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:06,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for db2dbab00e33f92f3002cd8639a68893: Waiting for close lock at 1675918986961Running coprocessor pre-close hooks at 1675918986961Disabling compacts and flushes for region at 1675918986961Disabling writes for close at 1675918986962 (+1 ms)Writing region close event to WAL at 1675918986963 (+1 ms)Running coprocessor post-close hooks at 1675918986967 (+4 ms)Closed at 1675918986967 2023-02-09 05:03:06,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:07,065 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39429,1675918982310; all regions closed. 2023-02-09 05:03:07,066 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46559,1675918982352; all regions closed. 2023-02-09 05:03:07,074 DEBUG [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs 2023-02-09 05:03:07,074 INFO [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46559%2C1675918982352.meta:.meta(num 1675918982933) 2023-02-09 05:03:07,082 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/WALs/jenkins-hbase4.apache.org,46559,1675918982352/jenkins-hbase4.apache.org%2C46559%2C1675918982352.1675918983705 not finished, retry = 0 2023-02-09 05:03:07,083 DEBUG [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs 2023-02-09 05:03:07,083 INFO [RS:0;jenkins-hbase4:39429] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39429%2C1675918982310:(num 1675918983685) 2023-02-09 05:03:07,083 DEBUG [RS:0;jenkins-hbase4:39429] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:07,083 INFO [RS:0;jenkins-hbase4:39429] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:07,083 INFO [RS:0;jenkins-hbase4:39429] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:07,083 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:07,083 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:07,083 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:07,084 INFO [RS:0;jenkins-hbase4:39429] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:07,084 INFO [RS:0;jenkins-hbase4:39429] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39429 2023-02-09 05:03:07,087 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:07,087 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:07,087 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39429,1675918982310 2023-02-09 05:03:07,087 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fc9e1c rejected from java.util.concurrent.ThreadPoolExecutor@4c30adb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,087 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:07,087 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1422838d rejected from java.util.concurrent.ThreadPoolExecutor@4c30adb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,087 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:07,087 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39429,1675918982310] 2023-02-09 05:03:07,088 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39429,1675918982310; numProcessing=1 2023-02-09 05:03:07,090 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39429,1675918982310 already deleted, retry=false 2023-02-09 05:03:07,090 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39429,1675918982310 expired; onlineServers=1 2023-02-09 05:03:07,185 DEBUG [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/oldWALs 2023-02-09 05:03:07,185 INFO [RS:1;jenkins-hbase4:46559] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46559%2C1675918982352:(num 1675918983705) 2023-02-09 05:03:07,185 DEBUG [RS:1;jenkins-hbase4:46559] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:07,185 INFO [RS:1;jenkins-hbase4:46559] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:07,185 INFO [RS:1;jenkins-hbase4:46559] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:07,186 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:07,186 INFO [RS:1;jenkins-hbase4:46559] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46559 2023-02-09 05:03:07,189 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:07,189 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46559,1675918982352 2023-02-09 05:03:07,189 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73e8df9d rejected from java.util.concurrent.ThreadPoolExecutor@77d74538[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,190 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46559,1675918982352] 2023-02-09 05:03:07,190 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46559,1675918982352; numProcessing=2 2023-02-09 05:03:07,191 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46559,1675918982352 already deleted, retry=false 2023-02-09 05:03:07,191 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46559,1675918982352 expired; onlineServers=0 2023-02-09 05:03:07,191 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40289,1675918982246' ***** 2023-02-09 05:03:07,191 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:07,192 DEBUG [M:0;jenkins-hbase4:40289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cca2b90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:07,192 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40289,1675918982246 2023-02-09 05:03:07,192 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40289,1675918982246; all regions closed. 2023-02-09 05:03:07,192 DEBUG [M:0;jenkins-hbase4:40289] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:07,192 DEBUG [M:0;jenkins-hbase4:40289] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:07,192 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:07,192 DEBUG [M:0;jenkins-hbase4:40289] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:07,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918982544] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918982544,5,FailOnTimeoutGroup] 2023-02-09 05:03:07,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918982544] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918982544,5,FailOnTimeoutGroup] 2023-02-09 05:03:07,195 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:07,194 INFO [M:0;jenkins-hbase4:40289] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:07,195 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:07,195 INFO [M:0;jenkins-hbase4:40289] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:07,195 INFO [M:0;jenkins-hbase4:40289] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:07,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:07,195 DEBUG [M:0;jenkins-hbase4:40289] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:07,195 INFO [M:0;jenkins-hbase4:40289] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:07,196 ERROR [M:0;jenkins-hbase4:40289] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:07,196 INFO [M:0;jenkins-hbase4:40289] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:07,196 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:07,197 DEBUG [M:0;jenkins-hbase4:40289] zookeeper.ZKUtil(398): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:07,197 WARN [M:0;jenkins-hbase4:40289] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:07,197 INFO [M:0;jenkins-hbase4:40289] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:07,197 INFO [M:0;jenkins-hbase4:40289] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:07,197 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:07,197 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:07,197 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:07,197 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:07,198 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:07,198 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.96 KB heapSize=120.63 KB 2023-02-09 05:03:07,207 INFO [M:0;jenkins-hbase4:40289] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.96 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fea885ec519845099ad60cd2d7b88f18 2023-02-09 05:03:07,211 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fea885ec519845099ad60cd2d7b88f18 as hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fea885ec519845099ad60cd2d7b88f18 2023-02-09 05:03:07,216 INFO [M:0;jenkins-hbase4:40289] regionserver.HStore(1080): Added hdfs://localhost:42695/user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fea885ec519845099ad60cd2d7b88f18, entries=31, sequenceid=218, filesize=9.0 K 2023-02-09 05:03:07,217 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegion(2947): Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false 2023-02-09 05:03:07,217 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:07,217 DEBUG [M:0;jenkins-hbase4:40289] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918987197Disabling compacts and flushes for region at 1675918987197Disabling writes for close at 1675918987198 (+1 ms)Obtaining lock to block concurrent updates at 1675918987198Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675918987198Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103386, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675918987198Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675918987199 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675918987199Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675918987201 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675918987201Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675918987212 (+11 ms)Finished flush of dataSize ~100.96 KB/103386, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=218, compaction requested=false at 1675918987217 (+5 ms)Writing region close event to WAL at 1675918987217Closed at 1675918987217 2023-02-09 05:03:07,222 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/0a5016fa-de00-89c3-4de4-95c5bd171d99/MasterData/WALs/jenkins-hbase4.apache.org,40289,1675918982246/jenkins-hbase4.apache.org%2C40289%2C1675918982246.1675918982447 not finished, retry = 0 2023-02-09 05:03:07,324 INFO [M:0;jenkins-hbase4:40289] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:07,324 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:07,325 INFO [M:0;jenkins-hbase4:40289] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40289 2023-02-09 05:03:07,327 DEBUG [M:0;jenkins-hbase4:40289] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40289,1675918982246 already deleted, retry=false 2023-02-09 05:03:07,357 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,357 INFO [RS:1;jenkins-hbase4:46559] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46559,1675918982352; zookeeper connection closed. 2023-02-09 05:03:07,357 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@368cf0da rejected from java.util.concurrent.ThreadPoolExecutor@77d74538[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,357 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@79771cbf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@79771cbf 2023-02-09 05:03:07,357 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:46559-0x100377625f60002, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,357 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e9ebe79 rejected from java.util.concurrent.ThreadPoolExecutor@77d74538[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,457 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,457 INFO [RS:0;jenkins-hbase4:39429] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39429,1675918982310; zookeeper connection closed. 2023-02-09 05:03:07,457 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c43ba6b rejected from java.util.concurrent.ThreadPoolExecutor@4c30adb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,457 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5111faa8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5111faa8 2023-02-09 05:03:07,457 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): regionserver:39429-0x100377625f60001, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,457 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21d0ba33 rejected from java.util.concurrent.ThreadPoolExecutor@4c30adb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,457 INFO [Listener at localhost/44057] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:07,557 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,557 INFO [M:0;jenkins-hbase4:40289] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40289,1675918982246; zookeeper connection closed. 2023-02-09 05:03:07,557 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f32012c rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,558 DEBUG [Listener at localhost/44057-EventThread] zookeeper.ZKWatcher(600): master:40289-0x100377625f60000, quorum=127.0.0.1:53139, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:07,558 ERROR [Listener at localhost/44057-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60af0345 rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:07,645 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop-4005605306930292581.jar 2023-02-09 05:03:07,649 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675918984768 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:07,650 DEBUG [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce 2023-02-09 05:03:07,650 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:07,650 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:07,650 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:07,650 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:07,650 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(239): region to add: db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=4e8a219a1656233e0c91d1c01d50f513 as 4e8a219a1656233e0c91d1c01d50f513 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=78398c7a13778a379fdf72f7b30a497d as 78398c7a13778a379fdf72f7b30a497d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=590b9bafcafbb0c77693892a98ab28d0 as 590b9bafcafbb0c77693892a98ab28d0 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=d07a11b131fd4699b3f627e8089605ba as d07a11b131fd4699b3f627e8089605ba in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=b1033bc66ce46722fb08b9a7214aad8f as b1033bc66ce46722fb08b9a7214aad8f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=c0b5ff6ddb1ad86741def9053e25c218 as c0b5ff6ddb1ad86741def9053e25c218 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=a3a7140a550730cb4392ef22b913b30b as a3a7140a550730cb4392ef22b913b30b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=418a18b8aa0b7fa0382874badb993295 as 418a18b8aa0b7fa0382874badb993295 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=dbb92db5a17e7445b64e2d1fee6ccef7 as dbb92db5a17e7445b64e2d1fee6ccef7 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,651 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(585): clone region=db2dbab00e33f92f3002cd8639a68893 as db2dbab00e33f92f3002cd8639a68893 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-09 05:03:07,653 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e8a219a1656233e0c91d1c01d50f513, NAME => 'testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,653 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => d07a11b131fd4699b3f627e8089605ba, NAME => 'testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,653 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 590b9bafcafbb0c77693892a98ab28d0, NAME => 'testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,654 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 78398c7a13778a379fdf72f7b30a497d, NAME => 'testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,654 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => a3a7140a550730cb4392ef22b913b30b, NAME => 'testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,654 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => c0b5ff6ddb1ad86741def9053e25c218, NAME => 'testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,654 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => b1033bc66ce46722fb08b9a7214aad8f, NAME => 'testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,656 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 418a18b8aa0b7fa0382874badb993295, NAME => 'testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,672 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,672 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02403ceea8294c66a7960de55d517044 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,676 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,676 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink aa024c2dfa7e4dee9fa9f32ff5861c08 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,680 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,680 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7ba4c4f1006b4a4ab85315693ab54753 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,684 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 61703ce2d2eb44898b25a06d1045ae0d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,688 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,688 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 64789797f5ac4c10bdc40ef7183f5d40 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,692 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 590b9bafcafbb0c77693892a98ab28d0, disabling compactions & flushes 2023-02-09 05:03:07,692 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:07,692 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:07,692 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. after waiting 0 ms 2023-02-09 05:03:07,693 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:07,693 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:07,693 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 590b9bafcafbb0c77693892a98ab28d0: Waiting for close lock at 1675918987692Disabling compacts and flushes for region at 1675918987692Disabling writes for close at 1675918987693 (+1 ms)Writing region close event to WAL at 1675918987693Closed at 1675918987693 2023-02-09 05:03:07,693 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => dbb92db5a17e7445b64e2d1fee6ccef7, NAME => 'testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,696 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,696 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cdf90bf91c1e4b50b53a7b2c23b679b1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,700 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,700 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d7f1e6f7206c4591a5f42ff6d3873a81 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,700 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2311d5c9da9b45e99e5097d5eaa94147 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,700 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing b1033bc66ce46722fb08b9a7214aad8f, disabling compactions & flushes 2023-02-09 05:03:07,700 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:07,701 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:07,701 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. after waiting 0 ms 2023-02-09 05:03:07,701 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:07,701 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:07,701 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for b1033bc66ce46722fb08b9a7214aad8f: Waiting for close lock at 1675918987700Disabling compacts and flushes for region at 1675918987700Disabling writes for close at 1675918987701 (+1 ms)Writing region close event to WAL at 1675918987701Closed at 1675918987701 2023-02-09 05:03:07,701 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => db2dbab00e33f92f3002cd8639a68893, NAME => 'testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,702 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b912d9a83bc3441e9702a0c6ea3d9e9f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,703 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b012e67ac95d496fb697bec3ebfaac1d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,703 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4e8a219a1656233e0c91d1c01d50f513, disabling compactions & flushes 2023-02-09 05:03:07,703 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:07,703 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:07,703 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. after waiting 0 ms 2023-02-09 05:03:07,703 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:07,703 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:07,703 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4e8a219a1656233e0c91d1c01d50f513: Waiting for close lock at 1675918987703Disabling compacts and flushes for region at 1675918987703Disabling writes for close at 1675918987703Writing region close event to WAL at 1675918987703Closed at 1675918987703 2023-02-09 05:03:07,708 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 418a18b8aa0b7fa0382874badb993295, disabling compactions & flushes 2023-02-09 05:03:07,708 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:07,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,708 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:07,708 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 32614a16d8cd4d73a011a37ed6c6c7e3 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,708 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. after waiting 0 ms 2023-02-09 05:03:07,709 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:07,709 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:07,709 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 418a18b8aa0b7fa0382874badb993295: Waiting for close lock at 1675918987708Disabling compacts and flushes for region at 1675918987708Disabling writes for close at 1675918987709 (+1 ms)Writing region close event to WAL at 1675918987709Closed at 1675918987709 2023-02-09 05:03:07,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing dbb92db5a17e7445b64e2d1fee6ccef7, disabling compactions & flushes 2023-02-09 05:03:07,711 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. after waiting 0 ms 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:07,711 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for dbb92db5a17e7445b64e2d1fee6ccef7: Waiting for close lock at 1675918987711Disabling compacts and flushes for region at 1675918987711Disabling writes for close at 1675918987711Writing region close event to WAL at 1675918987711Closed at 1675918987711 2023-02-09 05:03:07,711 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,711 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d38cfe15e36d4defaf576f654546e2db from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 78398c7a13778a379fdf72f7b30a497d, disabling compactions & flushes 2023-02-09 05:03:07,713 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:07,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:07,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. after waiting 0 ms 2023-02-09 05:03:07,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:07,713 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:07,713 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 78398c7a13778a379fdf72f7b30a497d: Waiting for close lock at 1675918987713Disabling compacts and flushes for region at 1675918987713Disabling writes for close at 1675918987713Writing region close event to WAL at 1675918987713Closed at 1675918987713 2023-02-09 05:03:07,713 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 222811c5b9ee406ab5ed2f7d0b9d45a7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,714 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing d07a11b131fd4699b3f627e8089605ba, disabling compactions & flushes 2023-02-09 05:03:07,714 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:07,714 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:07,714 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. after waiting 0 ms 2023-02-09 05:03:07,714 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:07,714 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:07,714 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for d07a11b131fd4699b3f627e8089605ba: Waiting for close lock at 1675918987714Disabling compacts and flushes for region at 1675918987714Disabling writes for close at 1675918987714Writing region close event to WAL at 1675918987714Closed at 1675918987714 2023-02-09 05:03:07,719 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c9789205756a43ada7aa933555634c81 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,719 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing c0b5ff6ddb1ad86741def9053e25c218, disabling compactions & flushes 2023-02-09 05:03:07,719 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:07,719 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:07,719 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. after waiting 0 ms 2023-02-09 05:03:07,719 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:07,719 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:07,719 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for c0b5ff6ddb1ad86741def9053e25c218: Waiting for close lock at 1675918987719Disabling compacts and flushes for region at 1675918987719Disabling writes for close at 1675918987719Writing region close event to WAL at 1675918987719Closed at 1675918987719 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:07,721 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 606f25136141412ca4e599f12df3b0f7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing a3a7140a550730cb4392ef22b913b30b, disabling compactions & flushes 2023-02-09 05:03:07,721 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. after waiting 0 ms 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:07,721 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:07,721 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for a3a7140a550730cb4392ef22b913b30b: Waiting for close lock at 1675918987721Disabling compacts and flushes for region at 1675918987721Disabling writes for close at 1675918987721Writing region close event to WAL at 1675918987721Closed at 1675918987721 2023-02-09 05:03:07,723 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e723ae514fe34728bcd688e1618a20c1 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-09 05:03:07,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing db2dbab00e33f92f3002cd8639a68893, disabling compactions & flushes 2023-02-09 05:03:07,725 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:07,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:07,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. after waiting 0 ms 2023-02-09 05:03:07,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:07,725 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:07,725 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for db2dbab00e33f92f3002cd8639a68893: Waiting for close lock at 1675918987725Disabling compacts and flushes for region at 1675918987725Disabling writes for close at 1675918987725Writing region close event to WAL at 1675918987725Closed at 1675918987725 2023-02-09 05:03:07,725 INFO [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675918984768 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:07,725 DEBUG [Listener at localhost/44057] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,725 DEBUG [Listener at localhost/44057] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97 2023-02-09 05:03:07,726 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:07,726 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:07,727 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 05:03:07,727 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------418a18b8aa0b7fa0382874badb993295/ 2023-02-09 05:03:07,728 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,728 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,728 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=418a18b8aa0b7fa0382874badb993295-64789797f5ac4c10bdc40ef7183f5d40 2023-02-09 05:03:07,728 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,729 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=418a18b8aa0b7fa0382874badb993295-b012e67ac95d496fb697bec3ebfaac1d 2023-02-09 05:03:07,729 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------4e8a219a1656233e0c91d1c01d50f513/ 2023-02-09 05:03:07,729 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,729 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,730 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=4e8a219a1656233e0c91d1c01d50f513-7ba4c4f1006b4a4ab85315693ab54753 2023-02-09 05:03:07,730 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,730 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=4e8a219a1656233e0c91d1c01d50f513-d7f1e6f7206c4591a5f42ff6d3873a81 2023-02-09 05:03:07,730 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------590b9bafcafbb0c77693892a98ab28d0/ 2023-02-09 05:03:07,730 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,731 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,731 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=590b9bafcafbb0c77693892a98ab28d0-02403ceea8294c66a7960de55d517044 2023-02-09 05:03:07,731 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,731 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=590b9bafcafbb0c77693892a98ab28d0-61703ce2d2eb44898b25a06d1045ae0d 2023-02-09 05:03:07,731 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------78398c7a13778a379fdf72f7b30a497d/ 2023-02-09 05:03:07,732 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,732 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,732 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=78398c7a13778a379fdf72f7b30a497d-aa024c2dfa7e4dee9fa9f32ff5861c08 2023-02-09 05:03:07,732 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=78398c7a13778a379fdf72f7b30a497d-2311d5c9da9b45e99e5097d5eaa94147 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------a3a7140a550730cb4392ef22b913b30b/ 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=a3a7140a550730cb4392ef22b913b30b-d38cfe15e36d4defaf576f654546e2db 2023-02-09 05:03:07,733 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,734 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=a3a7140a550730cb4392ef22b913b30b-c9789205756a43ada7aa933555634c81 2023-02-09 05:03:07,734 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------b1033bc66ce46722fb08b9a7214aad8f/ 2023-02-09 05:03:07,734 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,734 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------c0b5ff6ddb1ad86741def9053e25c218/ 2023-02-09 05:03:07,735 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,735 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,735 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=c0b5ff6ddb1ad86741def9053e25c218-32614a16d8cd4d73a011a37ed6c6c7e3 2023-02-09 05:03:07,735 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,736 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=c0b5ff6ddb1ad86741def9053e25c218-222811c5b9ee406ab5ed2f7d0b9d45a7 2023-02-09 05:03:07,736 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------d07a11b131fd4699b3f627e8089605ba/ 2023-02-09 05:03:07,736 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,736 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,737 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=d07a11b131fd4699b3f627e8089605ba-cdf90bf91c1e4b50b53a7b2c23b679b1 2023-02-09 05:03:07,737 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,737 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=d07a11b131fd4699b3f627e8089605ba-b912d9a83bc3441e9702a0c6ea3d9e9f 2023-02-09 05:03:07,737 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------db2dbab00e33f92f3002cd8639a68893/ 2023-02-09 05:03:07,738 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,738 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:07,738 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=db2dbab00e33f92f3002cd8639a68893-606f25136141412ca4e599f12df3b0f7 2023-02-09 05:03:07,738 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:07,739 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |----------------testWithMapReduce=db2dbab00e33f92f3002cd8639a68893-e723ae514fe34728bcd688e1618a20c1 2023-02-09 05:03:07,739 DEBUG [Listener at localhost/44057] util.CommonFSUtils(699): |----------dbb92db5a17e7445b64e2d1fee6ccef7/ 2023-02-09 05:03:07,739 DEBUG [Listener at localhost/44057] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:07,739 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:07,740 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:07,740 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:07,741 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,611 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop-3398004439341227117.jar 2023-02-09 05:03:08,612 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,612 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,677 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop-4282422343923736513.jar 2023-02-09 05:03:08,678 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,678 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,679 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,679 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,679 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,680 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,680 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 05:03:08,681 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 05:03:08,681 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 05:03:08,681 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 05:03:08,682 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 05:03:08,682 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 05:03:08,683 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 05:03:08,683 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 05:03:08,683 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 05:03:08,684 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 05:03:08,684 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:08,685 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:08,685 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:08,685 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:08,686 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:03:08,751 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop-749467873878648447.jar 2023-02-09 05:03:08,752 DEBUG [Listener at localhost/44057] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:03:08,757 WARN [Listener at localhost/44057] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 05:03:08,762 WARN [Listener at localhost/44057] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 05:03:08,769 INFO [Listener at localhost/44057] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 05:03:08,878 WARN [Listener at localhost/44057] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/mapreduce.cluster.local.dir/1675918988846/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 05:03:08,878 WARN [Listener at localhost/44057] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/mapreduce.cluster.local.dir/1675918988846/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 05:03:08,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:08,913 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:08,915 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:08,917 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:08,919 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1 2023-02-09 05:03:08,919 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 418a18b8aa0b7fa0382874badb993295 columnFamilyName f1 2023-02-09 05:03:08,925 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f1/testWithMapReduce=418a18b8aa0b7fa0382874badb993295-64789797f5ac4c10bdc40ef7183f5d40 2023-02-09 05:03:08,925 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(310): Store=418a18b8aa0b7fa0382874badb993295/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:08,925 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 418a18b8aa0b7fa0382874badb993295 2023-02-09 05:03:08,926 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2 2023-02-09 05:03:08,926 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 418a18b8aa0b7fa0382874badb993295 columnFamilyName f2 2023-02-09 05:03:08,931 DEBUG [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/418a18b8aa0b7fa0382874badb993295/f2/testWithMapReduce=418a18b8aa0b7fa0382874badb993295-b012e67ac95d496fb697bec3ebfaac1d 2023-02-09 05:03:08,931 INFO [StoreOpener-418a18b8aa0b7fa0382874badb993295-1] regionserver.HStore(310): Store=418a18b8aa0b7fa0382874badb993295/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:08,931 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:08,932 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 418a18b8aa0b7fa0382874badb993295; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70968831, jitterRate=0.057517990469932556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:08,932 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 418a18b8aa0b7fa0382874badb993295: Writing region info on filesystem at 1675918988915Initializing all the Stores at 1675918988916 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918988916Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918988917 (+1 ms)Region opened successfully at 1675918988932 (+15 ms) 2023-02-09 05:03:08,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 418a18b8aa0b7fa0382874badb993295, disabling compactions & flushes 2023-02-09 05:03:08,963 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:08,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:08,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. after waiting 0 ms 2023-02-09 05:03:08,963 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:08,964 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675918983892.418a18b8aa0b7fa0382874badb993295. 2023-02-09 05:03:08,964 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 418a18b8aa0b7fa0382874badb993295: Waiting for close lock at 1675918988963Disabling compacts and flushes for region at 1675918988963Disabling writes for close at 1675918988963Writing region close event to WAL at 1675918988964 (+1 ms)Closed at 1675918988964 2023-02-09 05:03:08,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:08,968 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:08,972 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:08,976 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:08,978 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f1 2023-02-09 05:03:08,978 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1033bc66ce46722fb08b9a7214aad8f columnFamilyName f1 2023-02-09 05:03:08,978 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(310): Store=b1033bc66ce46722fb08b9a7214aad8f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:08,979 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b1033bc66ce46722fb08b9a7214aad8f 2023-02-09 05:03:08,980 DEBUG [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/b1033bc66ce46722fb08b9a7214aad8f/f2 2023-02-09 05:03:08,980 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1033bc66ce46722fb08b9a7214aad8f columnFamilyName f2 2023-02-09 05:03:08,981 INFO [StoreOpener-b1033bc66ce46722fb08b9a7214aad8f-1] regionserver.HStore(310): Store=b1033bc66ce46722fb08b9a7214aad8f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:08,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:08,981 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b1033bc66ce46722fb08b9a7214aad8f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73636967, jitterRate=0.09727631509304047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:08,981 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b1033bc66ce46722fb08b9a7214aad8f: Writing region info on filesystem at 1675918988972Initializing all the Stores at 1675918988973 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918988973Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918988975 (+2 ms)Region opened successfully at 1675918988981 (+6 ms) 2023-02-09 05:03:08,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b1033bc66ce46722fb08b9a7214aad8f, disabling compactions & flushes 2023-02-09 05:03:08,998 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:08,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:08,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. after waiting 0 ms 2023-02-09 05:03:08,998 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:08,999 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675918983892.b1033bc66ce46722fb08b9a7214aad8f. 2023-02-09 05:03:08,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b1033bc66ce46722fb08b9a7214aad8f: Waiting for close lock at 1675918988998Disabling compacts and flushes for region at 1675918988998Disabling writes for close at 1675918988998Writing region close event to WAL at 1675918988999 (+1 ms)Closed at 1675918988999 2023-02-09 05:03:09,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,002 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,003 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,005 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:09,006 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1 2023-02-09 05:03:09,006 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8a219a1656233e0c91d1c01d50f513 columnFamilyName f1 2023-02-09 05:03:09,011 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f1/testWithMapReduce=4e8a219a1656233e0c91d1c01d50f513-7ba4c4f1006b4a4ab85315693ab54753 2023-02-09 05:03:09,011 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(310): Store=4e8a219a1656233e0c91d1c01d50f513/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,011 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e8a219a1656233e0c91d1c01d50f513 2023-02-09 05:03:09,012 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2 2023-02-09 05:03:09,012 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8a219a1656233e0c91d1c01d50f513 columnFamilyName f2 2023-02-09 05:03:09,017 DEBUG [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/4e8a219a1656233e0c91d1c01d50f513/f2/testWithMapReduce=4e8a219a1656233e0c91d1c01d50f513-d7f1e6f7206c4591a5f42ff6d3873a81 2023-02-09 05:03:09,017 INFO [StoreOpener-4e8a219a1656233e0c91d1c01d50f513-1] regionserver.HStore(310): Store=4e8a219a1656233e0c91d1c01d50f513/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,018 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e8a219a1656233e0c91d1c01d50f513; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61325090, jitterRate=-0.08618494868278503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e8a219a1656233e0c91d1c01d50f513: Writing region info on filesystem at 1675918989003Initializing all the Stores at 1675918989004 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989004Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989004Region opened successfully at 1675918989018 (+14 ms) 2023-02-09 05:03:09,060 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e8a219a1656233e0c91d1c01d50f513, disabling compactions & flushes 2023-02-09 05:03:09,061 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:09,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:09,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. after waiting 0 ms 2023-02-09 05:03:09,061 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:09,064 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675918983892.4e8a219a1656233e0c91d1c01d50f513. 2023-02-09 05:03:09,064 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e8a219a1656233e0c91d1c01d50f513: Waiting for close lock at 1675918989060Disabling compacts and flushes for region at 1675918989060Disabling writes for close at 1675918989061 (+1 ms)Writing region close event to WAL at 1675918989064 (+3 ms)Closed at 1675918989064 2023-02-09 05:03:09,068 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,068 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,070 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,071 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:09,072 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1 2023-02-09 05:03:09,073 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 590b9bafcafbb0c77693892a98ab28d0 columnFamilyName f1 2023-02-09 05:03:09,078 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f1/testWithMapReduce=590b9bafcafbb0c77693892a98ab28d0-02403ceea8294c66a7960de55d517044 2023-02-09 05:03:09,078 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(310): Store=590b9bafcafbb0c77693892a98ab28d0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,078 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 590b9bafcafbb0c77693892a98ab28d0 2023-02-09 05:03:09,079 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2 2023-02-09 05:03:09,079 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 590b9bafcafbb0c77693892a98ab28d0 columnFamilyName f2 2023-02-09 05:03:09,083 DEBUG [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/590b9bafcafbb0c77693892a98ab28d0/f2/testWithMapReduce=590b9bafcafbb0c77693892a98ab28d0-61703ce2d2eb44898b25a06d1045ae0d 2023-02-09 05:03:09,084 INFO [StoreOpener-590b9bafcafbb0c77693892a98ab28d0-1] regionserver.HStore(310): Store=590b9bafcafbb0c77693892a98ab28d0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,084 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 590b9bafcafbb0c77693892a98ab28d0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65885865, jitterRate=-0.01822410523891449}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,084 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 590b9bafcafbb0c77693892a98ab28d0: Writing region info on filesystem at 1675918989070Initializing all the Stores at 1675918989071 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989071Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989071Region opened successfully at 1675918989084 (+13 ms) 2023-02-09 05:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 590b9bafcafbb0c77693892a98ab28d0, disabling compactions & flushes 2023-02-09 05:03:09,119 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. after waiting 0 ms 2023-02-09 05:03:09,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:09,120 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675918983892.590b9bafcafbb0c77693892a98ab28d0. 2023-02-09 05:03:09,120 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 590b9bafcafbb0c77693892a98ab28d0: Waiting for close lock at 1675918989119Disabling compacts and flushes for region at 1675918989119Disabling writes for close at 1675918989119Writing region close event to WAL at 1675918989120 (+1 ms)Closed at 1675918989120 2023-02-09 05:03:09,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,125 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,128 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,132 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:09,134 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1 2023-02-09 05:03:09,134 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78398c7a13778a379fdf72f7b30a497d columnFamilyName f1 2023-02-09 05:03:09,140 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f1/testWithMapReduce=78398c7a13778a379fdf72f7b30a497d-aa024c2dfa7e4dee9fa9f32ff5861c08 2023-02-09 05:03:09,140 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(310): Store=78398c7a13778a379fdf72f7b30a497d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,140 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 78398c7a13778a379fdf72f7b30a497d 2023-02-09 05:03:09,141 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2 2023-02-09 05:03:09,142 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78398c7a13778a379fdf72f7b30a497d columnFamilyName f2 2023-02-09 05:03:09,147 DEBUG [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/78398c7a13778a379fdf72f7b30a497d/f2/testWithMapReduce=78398c7a13778a379fdf72f7b30a497d-2311d5c9da9b45e99e5097d5eaa94147 2023-02-09 05:03:09,148 INFO [StoreOpener-78398c7a13778a379fdf72f7b30a497d-1] regionserver.HStore(310): Store=78398c7a13778a379fdf72f7b30a497d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,148 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 78398c7a13778a379fdf72f7b30a497d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62375673, jitterRate=-0.07053004205226898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,148 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 78398c7a13778a379fdf72f7b30a497d: Writing region info on filesystem at 1675918989128Initializing all the Stores at 1675918989129 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989129Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989132 (+3 ms)Region opened successfully at 1675918989148 (+16 ms) 2023-02-09 05:03:09,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 78398c7a13778a379fdf72f7b30a497d, disabling compactions & flushes 2023-02-09 05:03:09,174 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:09,174 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:09,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. after waiting 0 ms 2023-02-09 05:03:09,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:09,175 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675918983892.78398c7a13778a379fdf72f7b30a497d. 2023-02-09 05:03:09,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 78398c7a13778a379fdf72f7b30a497d: Waiting for close lock at 1675918989174Disabling compacts and flushes for region at 1675918989174Disabling writes for close at 1675918989175 (+1 ms)Writing region close event to WAL at 1675918989175Closed at 1675918989175 2023-02-09 05:03:09,178 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,178 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,180 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,182 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:09,183 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f1 2023-02-09 05:03:09,183 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb92db5a17e7445b64e2d1fee6ccef7 columnFamilyName f1 2023-02-09 05:03:09,184 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(310): Store=dbb92db5a17e7445b64e2d1fee6ccef7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,184 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region dbb92db5a17e7445b64e2d1fee6ccef7 2023-02-09 05:03:09,185 DEBUG [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/dbb92db5a17e7445b64e2d1fee6ccef7/f2 2023-02-09 05:03:09,185 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb92db5a17e7445b64e2d1fee6ccef7 columnFamilyName f2 2023-02-09 05:03:09,186 INFO [StoreOpener-dbb92db5a17e7445b64e2d1fee6ccef7-1] regionserver.HStore(310): Store=dbb92db5a17e7445b64e2d1fee6ccef7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,186 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened dbb92db5a17e7445b64e2d1fee6ccef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61214846, jitterRate=-0.08782771229743958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for dbb92db5a17e7445b64e2d1fee6ccef7: Writing region info on filesystem at 1675918989180Initializing all the Stores at 1675918989181 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989181Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989181Region opened successfully at 1675918989186 (+5 ms) 2023-02-09 05:03:09,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing dbb92db5a17e7445b64e2d1fee6ccef7, disabling compactions & flushes 2023-02-09 05:03:09,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:09,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:09,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. after waiting 0 ms 2023-02-09 05:03:09,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:09,204 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675918983892.dbb92db5a17e7445b64e2d1fee6ccef7. 2023-02-09 05:03:09,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for dbb92db5a17e7445b64e2d1fee6ccef7: Waiting for close lock at 1675918989204Disabling compacts and flushes for region at 1675918989204Disabling writes for close at 1675918989204Writing region close event to WAL at 1675918989204Closed at 1675918989204 2023-02-09 05:03:09,207 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,207 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,208 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,210 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:09,211 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1 2023-02-09 05:03:09,211 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07a11b131fd4699b3f627e8089605ba columnFamilyName f1 2023-02-09 05:03:09,217 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f1/testWithMapReduce=d07a11b131fd4699b3f627e8089605ba-cdf90bf91c1e4b50b53a7b2c23b679b1 2023-02-09 05:03:09,217 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(310): Store=d07a11b131fd4699b3f627e8089605ba/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,217 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d07a11b131fd4699b3f627e8089605ba 2023-02-09 05:03:09,218 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2 2023-02-09 05:03:09,218 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d07a11b131fd4699b3f627e8089605ba columnFamilyName f2 2023-02-09 05:03:09,222 DEBUG [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/d07a11b131fd4699b3f627e8089605ba/f2/testWithMapReduce=d07a11b131fd4699b3f627e8089605ba-b912d9a83bc3441e9702a0c6ea3d9e9f 2023-02-09 05:03:09,222 INFO [StoreOpener-d07a11b131fd4699b3f627e8089605ba-1] regionserver.HStore(310): Store=d07a11b131fd4699b3f627e8089605ba/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,223 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,223 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d07a11b131fd4699b3f627e8089605ba; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62466130, jitterRate=-0.0691821277141571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,223 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d07a11b131fd4699b3f627e8089605ba: Writing region info on filesystem at 1675918989208Initializing all the Stores at 1675918989209 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989209Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989209Region opened successfully at 1675918989223 (+14 ms) 2023-02-09 05:03:09,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d07a11b131fd4699b3f627e8089605ba, disabling compactions & flushes 2023-02-09 05:03:09,260 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:09,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:09,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. after waiting 0 ms 2023-02-09 05:03:09,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:09,261 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675918983892.d07a11b131fd4699b3f627e8089605ba. 2023-02-09 05:03:09,261 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d07a11b131fd4699b3f627e8089605ba: Waiting for close lock at 1675918989260Disabling compacts and flushes for region at 1675918989260Disabling writes for close at 1675918989261 (+1 ms)Writing region close event to WAL at 1675918989261Closed at 1675918989261 2023-02-09 05:03:09,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,264 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,265 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,267 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:09,268 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1 2023-02-09 05:03:09,268 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db2dbab00e33f92f3002cd8639a68893 columnFamilyName f1 2023-02-09 05:03:09,273 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f1/testWithMapReduce=db2dbab00e33f92f3002cd8639a68893-606f25136141412ca4e599f12df3b0f7 2023-02-09 05:03:09,273 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(310): Store=db2dbab00e33f92f3002cd8639a68893/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,273 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region db2dbab00e33f92f3002cd8639a68893 2023-02-09 05:03:09,274 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2 2023-02-09 05:03:09,275 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db2dbab00e33f92f3002cd8639a68893 columnFamilyName f2 2023-02-09 05:03:09,279 DEBUG [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/db2dbab00e33f92f3002cd8639a68893/f2/testWithMapReduce=db2dbab00e33f92f3002cd8639a68893-e723ae514fe34728bcd688e1618a20c1 2023-02-09 05:03:09,279 INFO [StoreOpener-db2dbab00e33f92f3002cd8639a68893-1] regionserver.HStore(310): Store=db2dbab00e33f92f3002cd8639a68893/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,279 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened db2dbab00e33f92f3002cd8639a68893; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64358643, jitterRate=-0.040981486439704895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for db2dbab00e33f92f3002cd8639a68893: Writing region info on filesystem at 1675918989265Initializing all the Stores at 1675918989266 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989266Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989266Region opened successfully at 1675918989279 (+13 ms) 2023-02-09 05:03:09,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing db2dbab00e33f92f3002cd8639a68893, disabling compactions & flushes 2023-02-09 05:03:09,307 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:09,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:09,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. after waiting 0 ms 2023-02-09 05:03:09,307 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:09,308 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675918983892.db2dbab00e33f92f3002cd8639a68893. 2023-02-09 05:03:09,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for db2dbab00e33f92f3002cd8639a68893: Waiting for close lock at 1675918989307Disabling compacts and flushes for region at 1675918989307Disabling writes for close at 1675918989307Writing region close event to WAL at 1675918989308 (+1 ms)Closed at 1675918989308 2023-02-09 05:03:09,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,311 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,312 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,316 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:09,317 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1 2023-02-09 05:03:09,318 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0b5ff6ddb1ad86741def9053e25c218 columnFamilyName f1 2023-02-09 05:03:09,322 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f1/testWithMapReduce=c0b5ff6ddb1ad86741def9053e25c218-32614a16d8cd4d73a011a37ed6c6c7e3 2023-02-09 05:03:09,323 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(310): Store=c0b5ff6ddb1ad86741def9053e25c218/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,323 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c0b5ff6ddb1ad86741def9053e25c218 2023-02-09 05:03:09,324 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2 2023-02-09 05:03:09,324 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0b5ff6ddb1ad86741def9053e25c218 columnFamilyName f2 2023-02-09 05:03:09,328 DEBUG [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/c0b5ff6ddb1ad86741def9053e25c218/f2/testWithMapReduce=c0b5ff6ddb1ad86741def9053e25c218-222811c5b9ee406ab5ed2f7d0b9d45a7 2023-02-09 05:03:09,328 INFO [StoreOpener-c0b5ff6ddb1ad86741def9053e25c218-1] regionserver.HStore(310): Store=c0b5ff6ddb1ad86741def9053e25c218/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,328 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c0b5ff6ddb1ad86741def9053e25c218; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70853815, jitterRate=0.055804118514060974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c0b5ff6ddb1ad86741def9053e25c218: Writing region info on filesystem at 1675918989312Initializing all the Stores at 1675918989313 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989313Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989316 (+3 ms)Region opened successfully at 1675918989328 (+12 ms) 2023-02-09 05:03:09,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c0b5ff6ddb1ad86741def9053e25c218, disabling compactions & flushes 2023-02-09 05:03:09,365 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:09,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:09,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. after waiting 0 ms 2023-02-09 05:03:09,365 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:09,366 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675918983892.c0b5ff6ddb1ad86741def9053e25c218. 2023-02-09 05:03:09,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c0b5ff6ddb1ad86741def9053e25c218: Waiting for close lock at 1675918989365Disabling compacts and flushes for region at 1675918989365Disabling writes for close at 1675918989365Writing region close event to WAL at 1675918989366 (+1 ms)Closed at 1675918989366 2023-02-09 05:03:09,368 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:09,369 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:09,370 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:09,372 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:09,373 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1 2023-02-09 05:03:09,373 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3a7140a550730cb4392ef22b913b30b columnFamilyName f1 2023-02-09 05:03:09,378 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f1/testWithMapReduce=a3a7140a550730cb4392ef22b913b30b-d38cfe15e36d4defaf576f654546e2db 2023-02-09 05:03:09,378 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(310): Store=a3a7140a550730cb4392ef22b913b30b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,378 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3a7140a550730cb4392ef22b913b30b 2023-02-09 05:03:09,379 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2 2023-02-09 05:03:09,380 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3a7140a550730cb4392ef22b913b30b columnFamilyName f2 2023-02-09 05:03:09,384 DEBUG [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(539): loaded hdfs://localhost:42695/user/jenkins/test-data/bcc0fa8c-9007-c6f2-d766-08332789b911/testWithMapReduceAndOfflineHBaseMultiRegion/8c1bb6b9-dd6c-411e-8102-673fe3889d97/data/default/testWithMapReduce/a3a7140a550730cb4392ef22b913b30b/f2/testWithMapReduce=a3a7140a550730cb4392ef22b913b30b-c9789205756a43ada7aa933555634c81 2023-02-09 05:03:09,384 INFO [StoreOpener-a3a7140a550730cb4392ef22b913b30b-1] regionserver.HStore(310): Store=a3a7140a550730cb4392ef22b913b30b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:09,384 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:09,385 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a3a7140a550730cb4392ef22b913b30b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69874554, jitterRate=0.041211992502212524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:09,385 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a3a7140a550730cb4392ef22b913b30b: Writing region info on filesystem at 1675918989370Initializing all the Stores at 1675918989371 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989371Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918989371Region opened successfully at 1675918989385 (+14 ms) 2023-02-09 05:03:09,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a3a7140a550730cb4392ef22b913b30b, disabling compactions & flushes 2023-02-09 05:03:09,412 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:09,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:09,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. after waiting 0 ms 2023-02-09 05:03:09,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:09,413 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675918983892.a3a7140a550730cb4392ef22b913b30b. 2023-02-09 05:03:09,413 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a3a7140a550730cb4392ef22b913b30b: Waiting for close lock at 1675918989412Disabling compacts and flushes for region at 1675918989412Disabling writes for close at 1675918989412Writing region close event to WAL at 1675918989413 (+1 ms)Closed at 1675918989413 2023-02-09 05:03:09,839 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:09,913 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:09,913 WARN [Listener at localhost/44057] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:09,917 INFO [Listener at localhost/44057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:10,022 WARN [BP-1436123105-172.31.14.131-1675918981587 heartbeating to localhost/127.0.0.1:42695] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:10,023 WARN [BP-1436123105-172.31.14.131-1675918981587 heartbeating to localhost/127.0.0.1:42695] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1436123105-172.31.14.131-1675918981587 (Datanode Uuid 3696a2ef-26ad-4722-b505-a658d27a77b6) service to localhost/127.0.0.1:42695 2023-02-09 05:03:10,024 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/dfs/data/data3/current/BP-1436123105-172.31.14.131-1675918981587] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:10,024 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/dfs/data/data4/current/BP-1436123105-172.31.14.131-1675918981587] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:10,025 WARN [Listener at localhost/44057] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:10,027 INFO [Listener at localhost/44057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:10,130 WARN [BP-1436123105-172.31.14.131-1675918981587 heartbeating to localhost/127.0.0.1:42695] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:10,130 WARN [BP-1436123105-172.31.14.131-1675918981587 heartbeating to localhost/127.0.0.1:42695] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1436123105-172.31.14.131-1675918981587 (Datanode Uuid dc34cd5e-a998-4723-b4d9-61a212dd9fbb) service to localhost/127.0.0.1:42695 2023-02-09 05:03:10,131 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/dfs/data/data1/current/BP-1436123105-172.31.14.131-1675918981587] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:10,131 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/cluster_e5c35e41-c8dc-fbad-854e-7ea9ca9bb59b/dfs/data/data2/current/BP-1436123105-172.31.14.131-1675918981587] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:10,140 INFO [Listener at localhost/44057] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:10,260 INFO [Listener at localhost/44057] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:10,316 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:10,329 INFO [Listener at localhost/44057] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 102) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42695 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:42695 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:42695 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42695 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40289,1675918982246)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42695 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42695 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/44057 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:42695 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) - Thread LEAK? -, OpenFileDescriptor=538 (was 538), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 289), ProcessCount=168 (was 168), AvailableMemoryMB=3831 (was 3971) 2023-02-09 05:03:10,341 INFO [Listener at localhost/44057] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=168, AvailableMemoryMB=3831 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.log.dir so I do NOT create it in target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b 2023-02-09 05:03:10,352 WARN [Listener at localhost/44057] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.tmp.dir so I do NOT create it in target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b 2023-02-09 05:03:10,352 WARN [Listener at localhost/44057] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/aaaa21ae-7f6c-9130-aa77-0db1f6addd0c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:10,352 DEBUG [Listener at localhost/44057] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a, deleteOnExit=true 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/test.cache.data in system properties and HBase conf 2023-02-09 05:03:10,352 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:10,353 DEBUG [Listener at localhost/44057] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:10,353 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:10,354 INFO [Listener at localhost/44057] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:10,358 WARN [Listener at localhost/44057] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:10,359 WARN [Listener at localhost/44057] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:10,402 WARN [Listener at localhost/44057] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:10,404 INFO [Listener at localhost/44057] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:10,411 INFO [Listener at localhost/44057] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/java.io.tmpdir/Jetty_localhost_37857_hdfs____ran15s/webapp 2023-02-09 05:03:10,503 INFO [Listener at localhost/44057] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37857 2023-02-09 05:03:10,507 WARN [Listener at localhost/44057] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:10,508 WARN [Listener at localhost/44057] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:10,544 WARN [Listener at localhost/45615] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:10,559 WARN [Listener at localhost/45615] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:10,562 WARN [Listener at localhost/45615] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:10,563 INFO [Listener at localhost/45615] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:10,569 INFO [Listener at localhost/45615] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/java.io.tmpdir/Jetty_localhost_38953_datanode____k7hwxl/webapp 2023-02-09 05:03:10,662 INFO [Listener at localhost/45615] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38953 2023-02-09 05:03:10,669 WARN [Listener at localhost/41847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:10,681 WARN [Listener at localhost/41847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:10,684 WARN [Listener at localhost/41847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:10,685 INFO [Listener at localhost/41847] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:10,690 INFO [Listener at localhost/41847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/java.io.tmpdir/Jetty_localhost_46111_datanode____.psum2y/webapp 2023-02-09 05:03:10,762 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd51d0805f1dafa05: Processing first storage report for DS-c18778f1-da36-4648-aec0-5551b0f181b4 from datanode bb392842-ac1b-4b02-8135-47dae8a6365f 2023-02-09 05:03:10,762 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd51d0805f1dafa05: from storage DS-c18778f1-da36-4648-aec0-5551b0f181b4 node DatanodeRegistration(127.0.0.1:45709, datanodeUuid=bb392842-ac1b-4b02-8135-47dae8a6365f, infoPort=37161, infoSecurePort=0, ipcPort=41847, storageInfo=lv=-57;cid=testClusterID;nsid=2021782511;c=1675918990361), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:10,762 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd51d0805f1dafa05: Processing first storage report for DS-fdefe4af-29d1-4e97-8873-b4cb8538e45e from datanode bb392842-ac1b-4b02-8135-47dae8a6365f 2023-02-09 05:03:10,762 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd51d0805f1dafa05: from storage DS-fdefe4af-29d1-4e97-8873-b4cb8538e45e node DatanodeRegistration(127.0.0.1:45709, datanodeUuid=bb392842-ac1b-4b02-8135-47dae8a6365f, infoPort=37161, infoSecurePort=0, ipcPort=41847, storageInfo=lv=-57;cid=testClusterID;nsid=2021782511;c=1675918990361), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:10,794 INFO [Listener at localhost/41847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46111 2023-02-09 05:03:10,800 WARN [Listener at localhost/42355] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:10,884 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6be345fcda56f27: Processing first storage report for DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59 from datanode 7b00d6de-69b7-405f-9dbe-0a62c2a9429d 2023-02-09 05:03:10,884 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6be345fcda56f27: from storage DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59 node DatanodeRegistration(127.0.0.1:36485, datanodeUuid=7b00d6de-69b7-405f-9dbe-0a62c2a9429d, infoPort=46755, infoSecurePort=0, ipcPort=42355, storageInfo=lv=-57;cid=testClusterID;nsid=2021782511;c=1675918990361), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:10,884 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd6be345fcda56f27: Processing first storage report for DS-4e2ed5fa-02b8-46a6-aca6-0d6577106a73 from datanode 7b00d6de-69b7-405f-9dbe-0a62c2a9429d 2023-02-09 05:03:10,885 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd6be345fcda56f27: from storage DS-4e2ed5fa-02b8-46a6-aca6-0d6577106a73 node DatanodeRegistration(127.0.0.1:36485, datanodeUuid=7b00d6de-69b7-405f-9dbe-0a62c2a9429d, infoPort=46755, infoSecurePort=0, ipcPort=42355, storageInfo=lv=-57;cid=testClusterID;nsid=2021782511;c=1675918990361), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:10,907 DEBUG [Listener at localhost/42355] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b 2023-02-09 05:03:10,909 INFO [Listener at localhost/42355] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/zookeeper_0, clientPort=56649, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:10,910 INFO [Listener at localhost/42355] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56649 2023-02-09 05:03:10,910 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,911 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,926 INFO [Listener at localhost/42355] util.FSUtils(479): Created version file at hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271 with version=8 2023-02-09 05:03:10,927 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,928 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,931 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45615/user/jenkins/test-data/c5099abf-6bfb-b470-71c3-fc519193e9c4/hbase-staging 2023-02-09 05:03:10,932 INFO [Listener at localhost/42355] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:10,933 INFO [Listener at localhost/42355] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:10,936 INFO [Listener at localhost/42355] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42983 2023-02-09 05:03:10,937 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,937 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,938 INFO [Listener at localhost/42355] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42983 connecting to ZooKeeper ensemble=127.0.0.1:56649 2023-02-09 05:03:10,946 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:429830x0, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:10,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42983-0x100377648020000 connected 2023-02-09 05:03:10,963 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:10,963 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:10,964 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:10,967 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42983 2023-02-09 05:03:10,967 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42983 2023-02-09 05:03:10,968 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42983 2023-02-09 05:03:10,969 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42983 2023-02-09 05:03:10,972 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42983 2023-02-09 05:03:10,972 INFO [Listener at localhost/42355] master.HMaster(439): hbase.rootdir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271, hbase.cluster.distributed=false 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:10,985 INFO [Listener at localhost/42355] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:10,987 INFO [Listener at localhost/42355] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44689 2023-02-09 05:03:10,987 INFO [Listener at localhost/42355] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:10,988 DEBUG [Listener at localhost/42355] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:10,988 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,989 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:10,990 INFO [Listener at localhost/42355] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44689 connecting to ZooKeeper ensemble=127.0.0.1:56649 2023-02-09 05:03:10,994 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:446890x0, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:10,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44689-0x100377648020001 connected 2023-02-09 05:03:10,996 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:10,996 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:10,997 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:11,000 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44689 2023-02-09 05:03:11,000 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44689 2023-02-09 05:03:11,000 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44689 2023-02-09 05:03:11,004 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44689 2023-02-09 05:03:11,004 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44689 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:11,015 INFO [Listener at localhost/42355] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:11,017 INFO [Listener at localhost/42355] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40585 2023-02-09 05:03:11,017 INFO [Listener at localhost/42355] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:11,018 DEBUG [Listener at localhost/42355] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:11,018 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:11,019 INFO [Listener at localhost/42355] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:11,020 INFO [Listener at localhost/42355] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40585 connecting to ZooKeeper ensemble=127.0.0.1:56649 2023-02-09 05:03:11,023 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:405850x0, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:11,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40585-0x100377648020002 connected 2023-02-09 05:03:11,025 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:11,025 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:11,026 DEBUG [Listener at localhost/42355] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:11,027 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40585 2023-02-09 05:03:11,028 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40585 2023-02-09 05:03:11,036 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40585 2023-02-09 05:03:11,036 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40585 2023-02-09 05:03:11,036 DEBUG [Listener at localhost/42355] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40585 2023-02-09 05:03:11,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,040 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:11,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,041 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:11,041 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:11,041 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,041 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:11,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:11,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42983,1675918990932 from backup master directory 2023-02-09 05:03:11,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:11,045 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,045 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:11,045 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:11,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/hbase.id with ID: 9b4e7639-a7f0-4abf-8292-0bb031d4b5b3 2023-02-09 05:03:11,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:11,071 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba3d731 to 127.0.0.1:56649 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:11,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@446b248a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:11,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:11,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:11,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:11,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store-tmp 2023-02-09 05:03:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:11,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:11,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918991099Disabling compacts and flushes for region at 1675918991099Disabling writes for close at 1675918991099Writing region close event to WAL at 1675918991099Closed at 1675918991100 (+1 ms) 2023-02-09 05:03:11,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/WALs/jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42983%2C1675918990932, suffix=, logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/WALs/jenkins-hbase4.apache.org,42983,1675918990932, archiveDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:11,122 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK] 2023-02-09 05:03:11,122 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK] 2023-02-09 05:03:11,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/WALs/jenkins-hbase4.apache.org,42983,1675918990932/jenkins-hbase4.apache.org%2C42983%2C1675918990932.1675918991103 2023-02-09 05:03:11,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK], DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK]] 2023-02-09 05:03:11,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:11,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,126 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,128 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:11,129 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:11,129 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:11,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:11,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68442704, jitterRate=0.019875764846801758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:11,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675918991125Initializing all the Stores at 1675918991126 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918991126Cleaning up temporary data from old regions at 1675918991131 (+5 ms)Cleaning up detritus from prior splits at 1675918991131Region opened successfully at 1675918991135 (+4 ms) 2023-02-09 05:03:11,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:11,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:11,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:11,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:11,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:11,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:11,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:11,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:11,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:11,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:11,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:11,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:11,154 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:11,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:11,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:11,157 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:11,157 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:11,157 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:11,158 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42983,1675918990932, sessionid=0x100377648020000, setting cluster-up flag (Was=false) 2023-02-09 05:03:11,164 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:11,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,172 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:11,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:11,178 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/.tmp 2023-02-09 05:03:11,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919021185 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:11,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,186 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:11,186 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:11,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918991187,5,FailOnTimeoutGroup] 2023-02-09 05:03:11,188 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:11,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918991188,5,FailOnTimeoutGroup] 2023-02-09 05:03:11,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:11,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,207 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:11,208 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:11,208 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271 2023-02-09 05:03:11,217 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:11,219 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/info 2023-02-09 05:03:11,220 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:11,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,220 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:11,221 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:11,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:11,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:11,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/table 2023-02-09 05:03:11,223 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:11,223 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,224 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740 2023-02-09 05:03:11,224 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740 2023-02-09 05:03:11,226 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:11,226 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:11,228 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:11,228 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61388894, jitterRate=-0.08523419499397278}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:11,228 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675918991217Initializing all the Stores at 1675918991218 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918991218Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918991218Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918991218Cleaning up temporary data from old regions at 1675918991225 (+7 ms)Cleaning up detritus from prior splits at 1675918991225Region opened successfully at 1675918991228 (+3 ms) 2023-02-09 05:03:11,229 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:11,229 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:11,229 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:11,229 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:11,229 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:11,229 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:11,229 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918991229Disabling compacts and flushes for region at 1675918991229Disabling writes for close at 1675918991229Writing region close event to WAL at 1675918991229Closed at 1675918991229 2023-02-09 05:03:11,230 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:11,230 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:11,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:11,231 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:11,233 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:11,239 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(952): ClusterId : 9b4e7639-a7f0-4abf-8292-0bb031d4b5b3 2023-02-09 05:03:11,239 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(952): ClusterId : 9b4e7639-a7f0-4abf-8292-0bb031d4b5b3 2023-02-09 05:03:11,239 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:11,239 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:11,241 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:11,241 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:11,241 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:11,241 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:11,249 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:11,250 DEBUG [RS:0;jenkins-hbase4:44689] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2c3afb to 127.0.0.1:56649 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:11,250 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:11,252 DEBUG [RS:1;jenkins-hbase4:40585] zookeeper.ReadOnlyZKClient(139): Connect 0x4f3ed01a to 127.0.0.1:56649 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:11,261 DEBUG [RS:0;jenkins-hbase4:44689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73ebdb2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:11,261 DEBUG [RS:1;jenkins-hbase4:40585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41f9278d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:11,261 DEBUG [RS:0;jenkins-hbase4:44689] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77d4518b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:11,261 DEBUG [RS:1;jenkins-hbase4:40585] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45c6bb6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:11,270 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40585 2023-02-09 05:03:11,270 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44689 2023-02-09 05:03:11,270 INFO [RS:1;jenkins-hbase4:40585] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:11,270 INFO [RS:0;jenkins-hbase4:44689] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:11,270 INFO [RS:1;jenkins-hbase4:40585] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:11,270 INFO [RS:0;jenkins-hbase4:44689] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:11,270 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:11,270 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:11,271 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42983,1675918990932 with isa=jenkins-hbase4.apache.org/172.31.14.131:40585, startcode=1675918991014 2023-02-09 05:03:11,271 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42983,1675918990932 with isa=jenkins-hbase4.apache.org/172.31.14.131:44689, startcode=1675918990984 2023-02-09 05:03:11,271 DEBUG [RS:1;jenkins-hbase4:40585] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:11,271 DEBUG [RS:0;jenkins-hbase4:44689] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:11,274 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39159, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:11,274 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52175, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:11,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42983] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,276 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271 2023-02-09 05:03:11,276 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45615 2023-02-09 05:03:11,276 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:11,276 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271 2023-02-09 05:03:11,276 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45615 2023-02-09 05:03:11,276 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:11,281 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:11,282 DEBUG [RS:0;jenkins-hbase4:44689] zookeeper.ZKUtil(162): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,282 WARN [RS:0;jenkins-hbase4:44689] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:11,282 INFO [RS:0;jenkins-hbase4:44689] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:11,282 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,282 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40585,1675918991014] 2023-02-09 05:03:11,283 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44689,1675918990984] 2023-02-09 05:03:11,283 DEBUG [RS:1;jenkins-hbase4:40585] zookeeper.ZKUtil(162): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,283 WARN [RS:1;jenkins-hbase4:40585] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:11,284 INFO [RS:1;jenkins-hbase4:40585] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:11,284 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,288 DEBUG [RS:0;jenkins-hbase4:44689] zookeeper.ZKUtil(162): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,288 DEBUG [RS:1;jenkins-hbase4:40585] zookeeper.ZKUtil(162): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,288 DEBUG [RS:0;jenkins-hbase4:44689] zookeeper.ZKUtil(162): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,288 DEBUG [RS:1;jenkins-hbase4:40585] zookeeper.ZKUtil(162): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,289 DEBUG [RS:0;jenkins-hbase4:44689] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:11,289 INFO [RS:0;jenkins-hbase4:44689] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:11,289 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:11,290 INFO [RS:1;jenkins-hbase4:40585] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:11,290 INFO [RS:0;jenkins-hbase4:44689] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:11,291 INFO [RS:0;jenkins-hbase4:44689] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:11,291 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,291 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:11,292 INFO [RS:1;jenkins-hbase4:40585] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:11,292 INFO [RS:1;jenkins-hbase4:40585] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:11,293 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,293 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:11,293 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,294 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,294 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:0;jenkins-hbase4:44689] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:11,295 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,295 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,296 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,296 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,296 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,296 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,296 DEBUG [RS:1;jenkins-hbase4:40585] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:11,300 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,300 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,300 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,311 INFO [RS:0;jenkins-hbase4:44689] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:11,311 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44689,1675918990984-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,315 INFO [RS:1;jenkins-hbase4:40585] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:11,315 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40585,1675918991014-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,327 INFO [RS:0;jenkins-hbase4:44689] regionserver.Replication(203): jenkins-hbase4.apache.org,44689,1675918990984 started 2023-02-09 05:03:11,327 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44689,1675918990984, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44689, sessionid=0x100377648020001 2023-02-09 05:03:11,327 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:11,327 DEBUG [RS:0;jenkins-hbase4:44689] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,327 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44689,1675918990984' 2023-02-09 05:03:11,327 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44689,1675918990984' 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:11,328 DEBUG [RS:0;jenkins-hbase4:44689] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:11,329 DEBUG [RS:0;jenkins-hbase4:44689] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:11,329 INFO [RS:0;jenkins-hbase4:44689] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:11,329 INFO [RS:0;jenkins-hbase4:44689] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:11,329 INFO [RS:1;jenkins-hbase4:40585] regionserver.Replication(203): jenkins-hbase4.apache.org,40585,1675918991014 started 2023-02-09 05:03:11,329 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40585,1675918991014, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40585, sessionid=0x100377648020002 2023-02-09 05:03:11,329 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40585,1675918991014' 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40585,1675918991014' 2023-02-09 05:03:11,330 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:11,331 DEBUG [RS:1;jenkins-hbase4:40585] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:11,331 DEBUG [RS:1;jenkins-hbase4:40585] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:11,331 INFO [RS:1;jenkins-hbase4:40585] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:11,331 INFO [RS:1;jenkins-hbase4:40585] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:11,383 DEBUG [jenkins-hbase4:42983] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:11,383 DEBUG [jenkins-hbase4:42983] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:11,384 DEBUG [jenkins-hbase4:42983] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:11,385 DEBUG [jenkins-hbase4:42983] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:11,385 DEBUG [jenkins-hbase4:42983] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:11,386 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40585,1675918991014, state=OPENING 2023-02-09 05:03:11,387 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:11,388 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:11,388 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:11,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40585,1675918991014}] 2023-02-09 05:03:11,543 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,543 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:11,544 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47980, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:11,548 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:11,548 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:11,550 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40585%2C1675918991014.meta, suffix=.meta, logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,40585,1675918991014, archiveDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs, maxLogs=32 2023-02-09 05:03:11,564 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK] 2023-02-09 05:03:11,564 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK] 2023-02-09 05:03:11,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,40585,1675918991014/jenkins-hbase4.apache.org%2C40585%2C1675918991014.meta.1675918991550.meta 2023-02-09 05:03:11,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK], DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK]] 2023-02-09 05:03:11,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:11,569 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:11,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:11,570 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:11,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/info 2023-02-09 05:03:11,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/info 2023-02-09 05:03:11,572 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:11,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,572 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:11,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:11,573 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:11,573 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:11,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,574 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:11,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/table 2023-02-09 05:03:11,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/table 2023-02-09 05:03:11,575 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:11,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,577 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740 2023-02-09 05:03:11,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740 2023-02-09 05:03:11,579 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:11,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:11,581 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71939781, jitterRate=0.07198627293109894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:11,581 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675918991569Writing region info on filesystem at 1675918991569Initializing all the Stores at 1675918991570 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918991570Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918991570Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918991570Cleaning up temporary data from old regions at 1675918991578 (+8 ms)Cleaning up detritus from prior splits at 1675918991579 (+1 ms)Running coprocessor post-open hooks at 1675918991581 (+2 ms)Region opened successfully at 1675918991581 2023-02-09 05:03:11,582 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675918991542 2023-02-09 05:03:11,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:11,586 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:11,586 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40585,1675918991014, state=OPEN 2023-02-09 05:03:11,588 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:11,588 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:11,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:11,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40585,1675918991014 in 200 msec 2023-02-09 05:03:11,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:11,591 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 359 msec 2023-02-09 05:03:11,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 412 msec 2023-02-09 05:03:11,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675918991040, completionTime=-1 2023-02-09 05:03:11,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:11,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:11,595 DEBUG [hconnection-0x132b0d9a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:11,596 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:11,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:11,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919051598 2023-02-09 05:03:11,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919111598 2023-02-09 05:03:11,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42983,1675918990932-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42983,1675918990932-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42983,1675918990932-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42983, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:11,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:11,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:11,608 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:11,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:11,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:11,610 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,611 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e empty. 2023-02-09 05:03:11,611 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,611 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:11,620 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:11,621 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d17a1b1d6bafc53e6f4ea93d1c4e806e, NAME => 'hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp 2023-02-09 05:03:11,629 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,629 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d17a1b1d6bafc53e6f4ea93d1c4e806e, disabling compactions & flushes 2023-02-09 05:03:11,629 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,629 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,629 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. after waiting 0 ms 2023-02-09 05:03:11,630 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,630 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,630 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d17a1b1d6bafc53e6f4ea93d1c4e806e: Waiting for close lock at 1675918991629Disabling compacts and flushes for region at 1675918991629Disabling writes for close at 1675918991630 (+1 ms)Writing region close event to WAL at 1675918991630Closed at 1675918991630 2023-02-09 05:03:11,631 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:11,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918991632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918991632"}]},"ts":"1675918991632"} 2023-02-09 05:03:11,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:11,635 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:11,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918991635"}]},"ts":"1675918991635"} 2023-02-09 05:03:11,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:11,639 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:11,640 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:11,640 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:11,640 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:11,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d17a1b1d6bafc53e6f4ea93d1c4e806e, ASSIGN}] 2023-02-09 05:03:11,642 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d17a1b1d6bafc53e6f4ea93d1c4e806e, ASSIGN 2023-02-09 05:03:11,643 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d17a1b1d6bafc53e6f4ea93d1c4e806e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40585,1675918991014; forceNewPlan=false, retain=false 2023-02-09 05:03:11,793 INFO [jenkins-hbase4:42983] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:11,794 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d17a1b1d6bafc53e6f4ea93d1c4e806e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918991794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918991794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918991794"}]},"ts":"1675918991794"} 2023-02-09 05:03:11,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d17a1b1d6bafc53e6f4ea93d1c4e806e, server=jenkins-hbase4.apache.org,40585,1675918991014}] 2023-02-09 05:03:11,952 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,953 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40585%2C1675918991014, suffix=, logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,40585,1675918991014, archiveDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs, maxLogs=32 2023-02-09 05:03:11,968 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK] 2023-02-09 05:03:11,969 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK] 2023-02-09 05:03:11,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,40585,1675918991014/jenkins-hbase4.apache.org%2C40585%2C1675918991014.1675918991954 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK], DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK]] 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d17a1b1d6bafc53e6f4ea93d1c4e806e, NAME => 'hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,973 INFO [StoreOpener-d17a1b1d6bafc53e6f4ea93d1c4e806e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,975 DEBUG [StoreOpener-d17a1b1d6bafc53e6f4ea93d1c4e806e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/info 2023-02-09 05:03:11,975 DEBUG [StoreOpener-d17a1b1d6bafc53e6f4ea93d1c4e806e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/info 2023-02-09 05:03:11,975 INFO [StoreOpener-d17a1b1d6bafc53e6f4ea93d1c4e806e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d17a1b1d6bafc53e6f4ea93d1c4e806e columnFamilyName info 2023-02-09 05:03:11,976 INFO [StoreOpener-d17a1b1d6bafc53e6f4ea93d1c4e806e-1] regionserver.HStore(310): Store=d17a1b1d6bafc53e6f4ea93d1c4e806e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:11,976 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,977 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,979 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:11,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:11,981 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d17a1b1d6bafc53e6f4ea93d1c4e806e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67538776, jitterRate=0.006406188011169434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:11,981 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d17a1b1d6bafc53e6f4ea93d1c4e806e: Running coprocessor pre-open hook at 1675918991972Writing region info on filesystem at 1675918991972Initializing all the Stores at 1675918991973 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918991973Cleaning up temporary data from old regions at 1675918991977 (+4 ms)Cleaning up detritus from prior splits at 1675918991977Running coprocessor post-open hooks at 1675918991981 (+4 ms)Region opened successfully at 1675918991981 2023-02-09 05:03:11,982 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e., pid=6, masterSystemTime=1675918991948 2023-02-09 05:03:11,984 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,984 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:11,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d17a1b1d6bafc53e6f4ea93d1c4e806e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:11,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918991984"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918991984"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918991984"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918991984"}]},"ts":"1675918991984"} 2023-02-09 05:03:11,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:11,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d17a1b1d6bafc53e6f4ea93d1c4e806e, server=jenkins-hbase4.apache.org,40585,1675918991014 in 189 msec 2023-02-09 05:03:11,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:11,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d17a1b1d6bafc53e6f4ea93d1c4e806e, ASSIGN in 347 msec 2023-02-09 05:03:11,989 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:11,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918991989"}]},"ts":"1675918991989"} 2023-02-09 05:03:11,991 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:11,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:11,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-09 05:03:12,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:12,009 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:12,009 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:12,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:12,021 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:12,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 05:03:12,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:12,043 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:12,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-09 05:03:12,059 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:12,062 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:12,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.016sec 2023-02-09 05:03:12,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:12,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:12,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:12,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42983,1675918990932-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:12,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42983,1675918990932-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:12,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:12,140 DEBUG [Listener at localhost/42355] zookeeper.ReadOnlyZKClient(139): Connect 0x0beffeb0 to 127.0.0.1:56649 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:12,145 DEBUG [Listener at localhost/42355] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e5de928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:12,146 DEBUG [hconnection-0x387e17b1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:12,148 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:12,149 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:12,149 DEBUG [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:12,149 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,149 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,151 DEBUG [Listener at localhost/42355] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:12,153 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51780, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:12,153 INFO [Listener at localhost/42355] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:12,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:12,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:12,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:51780 deadline: 1675919052154, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:12,154 INFO [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 05:03:12,155 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,155 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:12,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:12,160 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:12,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-09 05:03:12,160 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,160 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:12,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:12,162 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,163 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 empty. 2023-02-09 05:03:12,163 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,163 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 05:03:12,175 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:12,176 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa861ec73aa1cff996e9af9110bbb6a1, NAME => 'testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing aa861ec73aa1cff996e9af9110bbb6a1, disabling compactions & flushes 2023-02-09 05:03:12,186 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. after waiting 0 ms 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,186 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,186 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for aa861ec73aa1cff996e9af9110bbb6a1: Waiting for close lock at 1675918992186Disabling compacts and flushes for region at 1675918992186Disabling writes for close at 1675918992186Writing region close event to WAL at 1675918992186Closed at 1675918992186 2023-02-09 05:03:12,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:12,189 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675918992188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918992188"}]},"ts":"1675918992188"} 2023-02-09 05:03:12,190 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:12,191 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:12,191 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918992191"}]},"ts":"1675918992191"} 2023-02-09 05:03:12,192 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-09 05:03:12,196 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:12,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:12,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:12,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:12,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, ASSIGN}] 2023-02-09 05:03:12,199 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, ASSIGN 2023-02-09 05:03:12,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44689,1675918990984; forceNewPlan=false, retain=false 2023-02-09 05:03:12,262 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,262 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:12,331 INFO [RS:0;jenkins-hbase4:44689] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44689%2C1675918990984, suffix=, logDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,44689,1675918990984, archiveDir=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs, maxLogs=32 2023-02-09 05:03:12,346 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK] 2023-02-09 05:03:12,346 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK] 2023-02-09 05:03:12,348 INFO [RS:0;jenkins-hbase4:44689] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,44689,1675918990984/jenkins-hbase4.apache.org%2C44689%2C1675918990984.1675918992331 2023-02-09 05:03:12,350 INFO [jenkins-hbase4:42983] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:12,351 DEBUG [RS:0;jenkins-hbase4:44689] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36485,DS-46bdac23-9908-4d02-bc65-c2b9c3c53a59,DISK], DatanodeInfoWithStorage[127.0.0.1:45709,DS-c18778f1-da36-4648-aec0-5551b0f181b4,DISK]] 2023-02-09 05:03:12,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa861ec73aa1cff996e9af9110bbb6a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,351 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675918992351"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918992351"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918992351"}]},"ts":"1675918992351"} 2023-02-09 05:03:12,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aa861ec73aa1cff996e9af9110bbb6a1, server=jenkins-hbase4.apache.org,44689,1675918990984}] 2023-02-09 05:03:12,463 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,463 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:12,505 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,505 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:12,507 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:12,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa861ec73aa1cff996e9af9110bbb6a1, NAME => 'testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,512 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,514 DEBUG [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1 2023-02-09 05:03:12,514 DEBUG [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1 2023-02-09 05:03:12,514 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa861ec73aa1cff996e9af9110bbb6a1 columnFamilyName f1 2023-02-09 05:03:12,515 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] regionserver.HStore(310): Store=aa861ec73aa1cff996e9af9110bbb6a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:12,515 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,516 DEBUG [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2 2023-02-09 05:03:12,516 DEBUG [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2 2023-02-09 05:03:12,516 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa861ec73aa1cff996e9af9110bbb6a1 columnFamilyName f2 2023-02-09 05:03:12,517 INFO [StoreOpener-aa861ec73aa1cff996e9af9110bbb6a1-1] regionserver.HStore(310): Store=aa861ec73aa1cff996e9af9110bbb6a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:12,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:12,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:12,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:12,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa861ec73aa1cff996e9af9110bbb6a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65792124, jitterRate=-0.019620954990386963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:12,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa861ec73aa1cff996e9af9110bbb6a1: Running coprocessor pre-open hook at 1675918992511Writing region info on filesystem at 1675918992511Initializing all the Stores at 1675918992512 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918992512Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918992512Cleaning up temporary data from old regions at 1675918992518 (+6 ms)Cleaning up detritus from prior splits at 1675918992518Running coprocessor post-open hooks at 1675918992523 (+5 ms)Region opened successfully at 1675918992523 2023-02-09 05:03:12,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1., pid=12, masterSystemTime=1675918992505 2023-02-09 05:03:12,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,527 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aa861ec73aa1cff996e9af9110bbb6a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675918992527"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918992527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918992527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918992527"}]},"ts":"1675918992527"} 2023-02-09 05:03:12,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 05:03:12,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aa861ec73aa1cff996e9af9110bbb6a1, server=jenkins-hbase4.apache.org,44689,1675918990984 in 177 msec 2023-02-09 05:03:12,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 05:03:12,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, ASSIGN in 334 msec 2023-02-09 05:03:12,534 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:12,534 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918992534"}]},"ts":"1675918992534"} 2023-02-09 05:03:12,536 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-09 05:03:12,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:12,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 381 msec 2023-02-09 05:03:12,765 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,765 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:12,767 INFO [Listener at localhost/42355] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-09 05:03:12,767 DEBUG [Listener at localhost/42355] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-09 05:03:12,767 INFO [Listener at localhost/42355] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:12,769 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-09 05:03:12,769 INFO [Listener at localhost/42355] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:12,769 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-09 05:03:12,769 INFO [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:12,788 DEBUG [hconnection-0x387e17b1-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:12,801 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:12,814 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44689] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,929 INFO [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:12,929 INFO [Listener at localhost/42355] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:12,929 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:12,930 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:12,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 05:03:12,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675918992931 (current time:1675918992931). 2023-02-09 05:03:12,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:12,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] zookeeper.ReadOnlyZKClient(139): Connect 0x22bdb97e to 127.0.0.1:56649 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:12,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4150cecc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:12,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:12,939 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:12,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22bdb97e to 127.0.0.1:56649 2023-02-09 05:03:12,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:12,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 05:03:12,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 05:03:12,944 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 05:03:12,945 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675919592945 2023-02-09 05:03:12,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-09 05:03:12,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:12,946 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:12,946 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:12,946 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-09 05:03:12,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 05:03:12,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-09 05:03:12,948 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 05:03:12,949 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675919592949 2023-02-09 05:03:12,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 05:03:12,964 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 05:03:12,964 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:12,965 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 05:03:12,965 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 05:03:12,966 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:12,966 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:12,968 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:12,968 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:12,968 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:12,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:12,968 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,968 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:12,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-09 05:03:12,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 05:03:12,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 05:03:12,970 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 05:03:12,970 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:12,970 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44689,1675918990984' joining acquired barrier for procedure (foo) in zk 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 05:03:12,971 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40585,1675918991014' joining acquired barrier for procedure (foo) in zk 2023-02-09 05:03:12,973 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,973 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:12,973 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,973 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:12,973 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:12,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44689,1675918990984' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 05:03:12,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54d91412[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:12,975 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 05:03:12,975 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 05:03:12,977 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 05:03:12,977 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:12,977 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:12,977 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 05:03:12,977 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 05:03:12,977 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:12,977 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40585,1675918991014' in zk 2023-02-09 05:03:12,977 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:12,977 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. started... 2023-02-09 05:03:12,978 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aa861ec73aa1cff996e9af9110bbb6a1 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 05:03:12,980 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 05:03:12,980 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:12,980 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 05:03:12,993 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f1/9ddb10ab27924740afcd8fd813add74d 2023-02-09 05:03:13,021 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f2/e6b00d3a5bfa44459f40fb2ea779da34 2023-02-09 05:03:13,026 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f1/9ddb10ab27924740afcd8fd813add74d as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d 2023-02-09 05:03:13,030 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:13,031 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f2/e6b00d3a5bfa44459f40fb2ea779da34 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34 2023-02-09 05:03:13,035 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:13,036 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for aa861ec73aa1cff996e9af9110bbb6a1 in 59ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:13,036 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-09 05:03:13,036 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aa861ec73aa1cff996e9af9110bbb6a1: 2023-02-09 05:03:13,036 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.' region-info for snapshot=foo 2023-02-09 05:03:13,036 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:13,036 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d] hfiles 2023-02-09 05:03:13,037 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d for snapshot=foo 2023-02-09 05:03:13,037 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34] hfiles 2023-02-09 05:03:13,037 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34 for snapshot=foo 2023-02-09 05:03:13,046 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:13,046 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. completed. 2023-02-09 05:03:13,046 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,046 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 05:03:13,046 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 05:03:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,046 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 05:03:13,047 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44689,1675918990984' in zk 2023-02-09 05:03:13,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 05:03:13,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:13,048 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:13,048 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 05:03:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:13,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:13,048 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:13,049 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 05:03:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:13,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,44689,1675918990984': 2023-02-09 05:03:13,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44689,1675918990984' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 05:03:13,052 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 05:03:13,052 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:13,052 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:13,052 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 05:03:13,053 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:13,054 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,054 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:13,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:13,054 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,054 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,055 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:13,055 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:13,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:13,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:13,056 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:13,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:13,057 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:13,058 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:13,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,064 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:13,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:13,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,064 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:13,065 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:13,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 05:03:13,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:13,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 05:03:13,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:13,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:13,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:13,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:13,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/.tmp/foo to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/foo 2023-02-09 05:03:13,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-09 05:03:13,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:13,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:13,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675918992945Consolidate snapshot: foo at 1675918993065 (+120 ms)Loading Region manifests for foo at 1675918993065Writing data manifest for foo at 1675918993068 (+3 ms)Verifying snapshot: foo at 1675918993081 (+13 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675918993104 (+23 ms) 2023-02-09 05:03:13,107 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-09 05:03:13,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 161 msec 2023-02-09 05:03:13,248 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:13,248 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,248 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-09 05:03:13,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:13,250 INFO [Listener at localhost/42355] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:13,250 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,250 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,254 INFO [Listener at localhost/42355] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:13,260 INFO [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:13,298 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44689] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,386 INFO [Listener at localhost/42355] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:13,390 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,390 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:13,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,394 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-09 05:03:13,394 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:13,395 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-09 05:03:13,395 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-09 05:03:13,396 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,396 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,397 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,397 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:13,397 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:13,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:13,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:13,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:13,397 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,398 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,399 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 05:03:13,400 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:13,400 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 05:03:13,400 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-09 05:03:13,400 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:13,400 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 05:03:13,401 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:13,401 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-09 05:03:13,401 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 05:03:13,401 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,401 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40585,1675918991014' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 05:03:13,401 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. started... 2023-02-09 05:03:13,401 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aa861ec73aa1cff996e9af9110bbb6a1 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 05:03:13,403 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,403 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,403 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:13,418 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f1/4a4d616d45064cb29a512dc6bc8828a0 2023-02-09 05:03:13,438 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f2/301cbb0ac1fa4807b68498f24eef6a42 2023-02-09 05:03:13,443 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f1/4a4d616d45064cb29a512dc6bc8828a0 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/4a4d616d45064cb29a512dc6bc8828a0 2023-02-09 05:03:13,447 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/4a4d616d45064cb29a512dc6bc8828a0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:13,447 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/.tmp/f2/301cbb0ac1fa4807b68498f24eef6a42 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/301cbb0ac1fa4807b68498f24eef6a42 2023-02-09 05:03:13,452 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/301cbb0ac1fa4807b68498f24eef6a42, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:13,453 INFO [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for aa861ec73aa1cff996e9af9110bbb6a1 in 52ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:13,454 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aa861ec73aa1cff996e9af9110bbb6a1: 2023-02-09 05:03:13,454 DEBUG [rs(jenkins-hbase4.apache.org,44689,1675918990984)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 05:03:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 05:03:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-09 05:03:13,454 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44689,1675918990984' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-09 05:03:13,456 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,456 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:13,456 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:13,456 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:13,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44689,1675918990984' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-09 05:03:13,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e69a51[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:13,458 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-09 05:03:13,458 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,44689,1675918990984' in zk 2023-02-09 05:03:13,460 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,40585,1675918991014' in zk 2023-02-09 05:03:13,460 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,460 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:13,462 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 05:03:13,462 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,462 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:13,462 DEBUG [member: 'jenkins-hbase4.apache.org,44689,1675918990984' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 05:03:13,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:13,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:13,463 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-09 05:03:13,463 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:13,463 DEBUG [member: 'jenkins-hbase4.apache.org,40585,1675918991014' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-09 05:03:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,44689,1675918990984': 2023-02-09 05:03:13,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44689,1675918990984' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-09 05:03:13,466 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-09 05:03:13,466 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:13,466 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:13,466 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,466 INFO [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:13,467 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,467 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:13,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,467 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:13,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:13,468 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:13,469 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:13,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,470 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,470 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:13,474 DEBUG [(jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:13,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-09 05:03:13,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:13,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:13,474 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:13,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:13,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:13,475 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,476 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:13,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:13,576 DEBUG [Listener at localhost/42355] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:13,576 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,576 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:13,582 INFO [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675918992931 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:13,582 DEBUG [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45615/user/jenkins/test-data/c5099abf-6bfb-b470-71c3-fc519193e9c4/foo/be624659-6b83-4308-9859-2cf992952975/data/default/testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,582 INFO [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(239): region to add: aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:13,582 INFO [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(585): clone region=aa861ec73aa1cff996e9af9110bbb6a1 as aa861ec73aa1cff996e9af9110bbb6a1 in snapshot foo 2023-02-09 05:03:13,583 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aa861ec73aa1cff996e9af9110bbb6a1, NAME => 'testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45615/user/jenkins/test-data/c5099abf-6bfb-b470-71c3-fc519193e9c4/foo/be624659-6b83-4308-9859-2cf992952975 2023-02-09 05:03:13,589 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:13,589 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ddb10ab27924740afcd8fd813add74d from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,591 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e6b00d3a5bfa44459f40fb2ea779da34 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aa861ec73aa1cff996e9af9110bbb6a1, disabling compactions & flushes 2023-02-09 05:03:13,593 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. after waiting 0 ms 2023-02-09 05:03:13,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,593 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,593 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aa861ec73aa1cff996e9af9110bbb6a1: Waiting for close lock at 1675918993593Disabling compacts and flushes for region at 1675918993593Disabling writes for close at 1675918993593Writing region close event to WAL at 1675918993593Closed at 1675918993593 2023-02-09 05:03:13,593 INFO [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675918992931 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:13,594 DEBUG [Listener at localhost/42355] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45615/user/jenkins/test-data/c5099abf-6bfb-b470-71c3-fc519193e9c4/foo/be624659-6b83-4308-9859-2cf992952975 2023-02-09 05:03:13,594 DEBUG [Listener at localhost/42355] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45615/user/jenkins/test-data/c5099abf-6bfb-b470-71c3-fc519193e9c4/foo/be624659-6b83-4308-9859-2cf992952975 2023-02-09 05:03:13,594 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:13,595 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:13,595 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-09 05:03:13,595 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |----------aa861ec73aa1cff996e9af9110bbb6a1/ 2023-02-09 05:03:13,596 DEBUG [Listener at localhost/42355] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:13,596 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:13,596 DEBUG [Listener at localhost/42355] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aa861ec73aa1cff996e9af9110bbb6a1-9ddb10ab27924740afcd8fd813add74d 2023-02-09 05:03:13,596 DEBUG [Listener at localhost/42355] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:13,596 DEBUG [Listener at localhost/42355] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aa861ec73aa1cff996e9af9110bbb6a1-e6b00d3a5bfa44459f40fb2ea779da34 2023-02-09 05:03:13,597 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,597 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 05:03:13,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 05:03:13,601 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,601 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,601 INFO [Listener at localhost/42355] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,604 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,604 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918993605"}]},"ts":"1675918993605"} 2023-02-09 05:03:13,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:13,606 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-09 05:03:13,607 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-09 05:03:13,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, UNASSIGN}] 2023-02-09 05:03:13,610 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, UNASSIGN 2023-02-09 05:03:13,611 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa861ec73aa1cff996e9af9110bbb6a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:13,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675918993610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918993610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918993610"}]},"ts":"1675918993610"} 2023-02-09 05:03:13,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure aa861ec73aa1cff996e9af9110bbb6a1, server=jenkins-hbase4.apache.org,44689,1675918990984}] 2023-02-09 05:03:13,705 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,705 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:13,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:13,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa861ec73aa1cff996e9af9110bbb6a1, disabling compactions & flushes 2023-02-09 05:03:13,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. after waiting 0 ms 2023-02-09 05:03:13,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:13,769 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1. 2023-02-09 05:03:13,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa861ec73aa1cff996e9af9110bbb6a1: Waiting for close lock at 1675918993764Running coprocessor pre-close hooks at 1675918993764Disabling compacts and flushes for region at 1675918993764Disabling writes for close at 1675918993765 (+1 ms)Writing region close event to WAL at 1675918993765Running coprocessor post-close hooks at 1675918993769 (+4 ms)Closed at 1675918993769 2023-02-09 05:03:13,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:13,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aa861ec73aa1cff996e9af9110bbb6a1, regionState=CLOSED 2023-02-09 05:03:13,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675918993771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918993771"}]},"ts":"1675918993771"} 2023-02-09 05:03:13,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 05:03:13,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure aa861ec73aa1cff996e9af9110bbb6a1, server=jenkins-hbase4.apache.org,44689,1675918990984 in 160 msec 2023-02-09 05:03:13,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 05:03:13,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aa861ec73aa1cff996e9af9110bbb6a1, UNASSIGN in 166 msec 2023-02-09 05:03:13,776 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918993776"}]},"ts":"1675918993776"} 2023-02-09 05:03:13,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-09 05:03:13,779 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-09 05:03:13,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 177 msec 2023-02-09 05:03:13,907 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,907 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:13,909 INFO [Listener at localhost/42355] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-09 05:03:13,909 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,909 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,912 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:13,912 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:13,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:13,915 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:13,917 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1, FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2, FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/recovered.edits] 2023-02-09 05:03:13,920 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/4a4d616d45064cb29a512dc6bc8828a0 to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/archive/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/4a4d616d45064cb29a512dc6bc8828a0 2023-02-09 05:03:13,921 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/archive/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f1/9ddb10ab27924740afcd8fd813add74d 2023-02-09 05:03:13,924 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/301cbb0ac1fa4807b68498f24eef6a42 to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/archive/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/301cbb0ac1fa4807b68498f24eef6a42 2023-02-09 05:03:13,925 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34 to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/archive/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/f2/e6b00d3a5bfa44459f40fb2ea779da34 2023-02-09 05:03:13,927 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/recovered.edits/12.seqid to hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/archive/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1/recovered.edits/12.seqid 2023-02-09 05:03:13,928 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aa861ec73aa1cff996e9af9110bbb6a1 2023-02-09 05:03:13,928 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-09 05:03:13,930 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,932 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-09 05:03:13,933 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-09 05:03:13,934 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,934 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-09 05:03:13,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675918993934"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:13,936 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 05:03:13,936 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aa861ec73aa1cff996e9af9110bbb6a1, NAME => 'testInitTableSnapshotMapperJobConfig,,1675918992157.aa861ec73aa1cff996e9af9110bbb6a1.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 05:03:13,936 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-09 05:03:13,936 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675918993936"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:13,939 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-09 05:03:13,941 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-09 05:03:13,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 31 msec 2023-02-09 05:03:14,013 INFO [Listener at localhost/42355] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:14,013 INFO [Listener at localhost/42355] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:14,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42983] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:14,015 INFO [Listener at localhost/42355] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-09 05:03:14,015 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:14,015 INFO [Listener at localhost/42355] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:14,015 DEBUG [Listener at localhost/42355] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0beffeb0 to 127.0.0.1:56649 2023-02-09 05:03:14,016 DEBUG [Listener at localhost/42355] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,016 DEBUG [Listener at localhost/42355] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:14,016 DEBUG [Listener at localhost/42355] util.JVMClusterUtil(257): Found active master hash=1623633008, stopped=false 2023-02-09 05:03:14,016 INFO [Listener at localhost/42355] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:14,018 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:14,019 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:14,019 INFO [Listener at localhost/42355] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:14,019 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:14,019 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:14,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:14,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:14,020 DEBUG [Listener at localhost/42355] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba3d731 to 127.0.0.1:56649 2023-02-09 05:03:14,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:14,021 DEBUG [Listener at localhost/42355] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,021 INFO [Listener at localhost/42355] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44689,1675918990984' ***** 2023-02-09 05:03:14,021 INFO [Listener at localhost/42355] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:14,021 INFO [Listener at localhost/42355] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40585,1675918991014' ***** 2023-02-09 05:03:14,021 INFO [Listener at localhost/42355] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:14,021 INFO [RS:1;jenkins-hbase4:40585] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:14,021 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:14,021 INFO [RS:0;jenkins-hbase4:44689] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:14,021 INFO [RS:1;jenkins-hbase4:40585] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:14,022 INFO [RS:0;jenkins-hbase4:44689] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:14,022 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:14,022 INFO [RS:0;jenkins-hbase4:44689] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:14,022 INFO [RS:1;jenkins-hbase4:40585] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:14,024 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(3304): Received CLOSE for d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:14,024 DEBUG [RS:0;jenkins-hbase4:44689] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2c3afb to 127.0.0.1:56649 2023-02-09 05:03:14,024 DEBUG [RS:0;jenkins-hbase4:44689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,024 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44689,1675918990984; all regions closed. 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:14,024 DEBUG [RS:1;jenkins-hbase4:40585] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f3ed01a to 127.0.0.1:56649 2023-02-09 05:03:14,024 DEBUG [RS:1;jenkins-hbase4:40585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:14,024 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d17a1b1d6bafc53e6f4ea93d1c4e806e, disabling compactions & flushes 2023-02-09 05:03:14,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:14,025 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 05:03:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:14,025 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1479): Online Regions={d17a1b1d6bafc53e6f4ea93d1c4e806e=hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 05:03:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. after waiting 0 ms 2023-02-09 05:03:14,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:14,025 DEBUG [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1505): Waiting on 1588230740, d17a1b1d6bafc53e6f4ea93d1c4e806e 2023-02-09 05:03:14,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d17a1b1d6bafc53e6f4ea93d1c4e806e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:14,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:14,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:14,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:14,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:14,026 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:14,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-09 05:03:14,028 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/WALs/jenkins-hbase4.apache.org,44689,1675918990984/jenkins-hbase4.apache.org%2C44689%2C1675918990984.1675918992331 not finished, retry = 0 2023-02-09 05:03:14,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/.tmp/info/2283e185c7104661a586ef2ab12590f1 2023-02-09 05:03:14,046 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/info/0b7f158caa964b1f98f3b940b7f0e9d5 2023-02-09 05:03:14,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/.tmp/info/2283e185c7104661a586ef2ab12590f1 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/info/2283e185c7104661a586ef2ab12590f1 2023-02-09 05:03:14,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b7f158caa964b1f98f3b940b7f0e9d5 2023-02-09 05:03:14,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/info/2283e185c7104661a586ef2ab12590f1, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:14,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d17a1b1d6bafc53e6f4ea93d1c4e806e in 31ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:14,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/rep_barrier/a6ac7b548021454baa97ffd366727177 2023-02-09 05:03:14,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/namespace/d17a1b1d6bafc53e6f4ea93d1c4e806e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:14,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:14,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d17a1b1d6bafc53e6f4ea93d1c4e806e: Waiting for close lock at 1675918994024Running coprocessor pre-close hooks at 1675918994024Disabling compacts and flushes for region at 1675918994024Disabling writes for close at 1675918994025 (+1 ms)Obtaining lock to block concurrent updates at 1675918994026 (+1 ms)Preparing flush snapshotting stores in d17a1b1d6bafc53e6f4ea93d1c4e806e at 1675918994026Finished memstore snapshotting hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675918994026Flushing stores of hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. at 1675918994027 (+1 ms)Flushing d17a1b1d6bafc53e6f4ea93d1c4e806e/info: creating writer at 1675918994027Flushing d17a1b1d6bafc53e6f4ea93d1c4e806e/info: appending metadata at 1675918994029 (+2 ms)Flushing d17a1b1d6bafc53e6f4ea93d1c4e806e/info: closing flushed file at 1675918994029Flushing d17a1b1d6bafc53e6f4ea93d1c4e806e/info: reopening flushed file at 1675918994051 (+22 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d17a1b1d6bafc53e6f4ea93d1c4e806e in 31ms, sequenceid=6, compaction requested=false at 1675918994056 (+5 ms)Writing region close event to WAL at 1675918994060 (+4 ms)Running coprocessor post-close hooks at 1675918994066 (+6 ms)Closed at 1675918994066 2023-02-09 05:03:14,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ac7b548021454baa97ffd366727177 2023-02-09 05:03:14,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675918991606.d17a1b1d6bafc53e6f4ea93d1c4e806e. 2023-02-09 05:03:14,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/table/1fe9000a2cdb487594c03ace5aa0a15e 2023-02-09 05:03:14,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fe9000a2cdb487594c03ace5aa0a15e 2023-02-09 05:03:14,077 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/info/0b7f158caa964b1f98f3b940b7f0e9d5 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/info/0b7f158caa964b1f98f3b940b7f0e9d5 2023-02-09 05:03:14,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b7f158caa964b1f98f3b940b7f0e9d5 2023-02-09 05:03:14,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/info/0b7f158caa964b1f98f3b940b7f0e9d5, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 05:03:14,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/rep_barrier/a6ac7b548021454baa97ffd366727177 as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/rep_barrier/a6ac7b548021454baa97ffd366727177 2023-02-09 05:03:14,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ac7b548021454baa97ffd366727177 2023-02-09 05:03:14,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/rep_barrier/a6ac7b548021454baa97ffd366727177, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 05:03:14,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/.tmp/table/1fe9000a2cdb487594c03ace5aa0a15e as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/table/1fe9000a2cdb487594c03ace5aa0a15e 2023-02-09 05:03:14,092 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fe9000a2cdb487594c03ace5aa0a15e 2023-02-09 05:03:14,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/table/1fe9000a2cdb487594c03ace5aa0a15e, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 05:03:14,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=21, compaction requested=false 2023-02-09 05:03:14,098 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:14,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 05:03:14,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:14,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:14,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918994025Running coprocessor pre-close hooks at 1675918994025Disabling compacts and flushes for region at 1675918994025Disabling writes for close at 1675918994026 (+1 ms)Obtaining lock to block concurrent updates at 1675918994026Preparing flush snapshotting stores in 1588230740 at 1675918994026Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675918994027 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675918994028 (+1 ms)Flushing 1588230740/info: creating writer at 1675918994028Flushing 1588230740/info: appending metadata at 1675918994030 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675918994030Flushing 1588230740/rep_barrier: creating writer at 1675918994051 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675918994053 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675918994053Flushing 1588230740/table: creating writer at 1675918994067 (+14 ms)Flushing 1588230740/table: appending metadata at 1675918994068 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675918994068Flushing 1588230740/info: reopening flushed file at 1675918994078 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675918994084 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675918994089 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 67ms, sequenceid=21, compaction requested=false at 1675918994093 (+4 ms)Writing region close event to WAL at 1675918994096 (+3 ms)Running coprocessor post-close hooks at 1675918994100 (+4 ms)Closed at 1675918994100 2023-02-09 05:03:14,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:14,102 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:14,130 DEBUG [RS:0;jenkins-hbase4:44689] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44689%2C1675918990984:(num 1675918992331) 2023-02-09 05:03:14,130 DEBUG [RS:0;jenkins-hbase4:44689] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:14,130 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:14,130 INFO [RS:0;jenkins-hbase4:44689] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:14,131 INFO [RS:0;jenkins-hbase4:44689] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44689 2023-02-09 05:03:14,132 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:14,132 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44689,1675918990984 2023-02-09 05:03:14,133 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:14,132 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:14,133 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7cdf9fb8 rejected from java.util.concurrent.ThreadPoolExecutor@78e014fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,133 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:14,133 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c375193 rejected from java.util.concurrent.ThreadPoolExecutor@78e014fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,134 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44689,1675918990984] 2023-02-09 05:03:14,134 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44689,1675918990984; numProcessing=1 2023-02-09 05:03:14,135 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44689,1675918990984 already deleted, retry=false 2023-02-09 05:03:14,135 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44689,1675918990984 expired; onlineServers=1 2023-02-09 05:03:14,226 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40585,1675918991014; all regions closed. 2023-02-09 05:03:14,230 DEBUG [RS:1;jenkins-hbase4:40585] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs 2023-02-09 05:03:14,230 INFO [RS:1;jenkins-hbase4:40585] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40585%2C1675918991014.meta:.meta(num 1675918991550) 2023-02-09 05:03:14,235 DEBUG [RS:1;jenkins-hbase4:40585] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/oldWALs 2023-02-09 05:03:14,235 INFO [RS:1;jenkins-hbase4:40585] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40585%2C1675918991014:(num 1675918991954) 2023-02-09 05:03:14,235 DEBUG [RS:1;jenkins-hbase4:40585] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,235 INFO [RS:1;jenkins-hbase4:40585] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:14,235 INFO [RS:1;jenkins-hbase4:40585] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:14,236 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:14,236 INFO [RS:1;jenkins-hbase4:40585] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40585 2023-02-09 05:03:14,239 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40585,1675918991014 2023-02-09 05:03:14,239 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:14,239 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40585,1675918991014] 2023-02-09 05:03:14,239 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40585,1675918991014; numProcessing=2 2023-02-09 05:03:14,240 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40585,1675918991014 already deleted, retry=false 2023-02-09 05:03:14,240 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40585,1675918991014 expired; onlineServers=0 2023-02-09 05:03:14,240 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42983,1675918990932' ***** 2023-02-09 05:03:14,240 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:14,241 DEBUG [M:0;jenkins-hbase4:42983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64f924b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:14,241 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42983,1675918990932 2023-02-09 05:03:14,241 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42983,1675918990932; all regions closed. 2023-02-09 05:03:14,241 DEBUG [M:0;jenkins-hbase4:42983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:14,241 DEBUG [M:0;jenkins-hbase4:42983] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:14,241 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:14,241 DEBUG [M:0;jenkins-hbase4:42983] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:14,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918991187] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918991187,5,FailOnTimeoutGroup] 2023-02-09 05:03:14,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918991188] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918991188,5,FailOnTimeoutGroup] 2023-02-09 05:03:14,242 INFO [M:0;jenkins-hbase4:42983] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:14,243 INFO [M:0;jenkins-hbase4:42983] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:14,243 INFO [M:0;jenkins-hbase4:42983] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:14,243 DEBUG [M:0;jenkins-hbase4:42983] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:14,243 INFO [M:0;jenkins-hbase4:42983] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:14,243 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:14,243 ERROR [M:0;jenkins-hbase4:42983] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:14,243 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:14,244 INFO [M:0;jenkins-hbase4:42983] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:14,244 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:14,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:14,244 DEBUG [M:0;jenkins-hbase4:42983] zookeeper.ZKUtil(398): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:14,244 WARN [M:0;jenkins-hbase4:42983] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:14,244 INFO [M:0;jenkins-hbase4:42983] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:14,245 INFO [M:0;jenkins-hbase4:42983] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:14,245 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:14,245 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:14,245 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:14,245 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:14,245 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:14,245 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.86 KB 2023-02-09 05:03:14,254 INFO [M:0;jenkins-hbase4:42983] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ede9dcd5e51d4d518ef4485929e3e66b 2023-02-09 05:03:14,258 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ede9dcd5e51d4d518ef4485929e3e66b as hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ede9dcd5e51d4d518ef4485929e3e66b 2023-02-09 05:03:14,261 INFO [M:0;jenkins-hbase4:42983] regionserver.HStore(1080): Added hdfs://localhost:45615/user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ede9dcd5e51d4d518ef4485929e3e66b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 05:03:14,262 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57252, heapSize ~66.84 KB/68448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-09 05:03:14,262 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:14,263 DEBUG [M:0;jenkins-hbase4:42983] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918994245Disabling compacts and flushes for region at 1675918994245Disabling writes for close at 1675918994245Obtaining lock to block concurrent updates at 1675918994245Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675918994245Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57252, getHeapSize=68448, getOffHeapSize=0, getCellsCount=145 at 1675918994245Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675918994246 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675918994247 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675918994249 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675918994249Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675918994258 (+9 ms)Finished flush of dataSize ~55.91 KB/57252, heapSize ~66.84 KB/68448, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1675918994262 (+4 ms)Writing region close event to WAL at 1675918994262Closed at 1675918994262 2023-02-09 05:03:14,266 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/ed815542-42d9-a7ac-f520-b61c343d7271/MasterData/WALs/jenkins-hbase4.apache.org,42983,1675918990932/jenkins-hbase4.apache.org%2C42983%2C1675918990932.1675918991103 not finished, retry = 0 2023-02-09 05:03:14,367 INFO [M:0;jenkins-hbase4:42983] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:14,367 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:14,368 INFO [M:0;jenkins-hbase4:42983] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42983 2023-02-09 05:03:14,370 DEBUG [M:0;jenkins-hbase4:42983] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42983,1675918990932 already deleted, retry=false 2023-02-09 05:03:14,519 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,519 INFO [M:0;jenkins-hbase4:42983] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42983,1675918990932; zookeeper connection closed. 2023-02-09 05:03:14,519 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f032a31 rejected from java.util.concurrent.ThreadPoolExecutor@b3caf09[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,520 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): master:42983-0x100377648020000, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,520 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@697ec2b8 rejected from java.util.concurrent.ThreadPoolExecutor@b3caf09[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,619 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,619 INFO [RS:1;jenkins-hbase4:40585] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40585,1675918991014; zookeeper connection closed. 2023-02-09 05:03:14,619 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b70801 rejected from java.util.concurrent.ThreadPoolExecutor@34889acf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,620 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:40585-0x100377648020002, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,620 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@354f14c5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@354f14c5 2023-02-09 05:03:14,620 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48cee8bd rejected from java.util.concurrent.ThreadPoolExecutor@34889acf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,720 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,720 INFO [RS:0;jenkins-hbase4:44689] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44689,1675918990984; zookeeper connection closed. 2023-02-09 05:03:14,720 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74aab757 rejected from java.util.concurrent.ThreadPoolExecutor@78e014fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,720 DEBUG [Listener at localhost/42355-EventThread] zookeeper.ZKWatcher(600): regionserver:44689-0x100377648020001, quorum=127.0.0.1:56649, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:14,720 ERROR [Listener at localhost/42355-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6bc0032f rejected from java.util.concurrent.ThreadPoolExecutor@78e014fb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:14,720 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d863d95] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d863d95 2023-02-09 05:03:14,720 INFO [Listener at localhost/42355] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:14,720 WARN [Listener at localhost/42355] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:14,724 INFO [Listener at localhost/42355] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:14,829 WARN [BP-1832122356-172.31.14.131-1675918990361 heartbeating to localhost/127.0.0.1:45615] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:14,830 WARN [BP-1832122356-172.31.14.131-1675918990361 heartbeating to localhost/127.0.0.1:45615] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1832122356-172.31.14.131-1675918990361 (Datanode Uuid 7b00d6de-69b7-405f-9dbe-0a62c2a9429d) service to localhost/127.0.0.1:45615 2023-02-09 05:03:14,830 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/dfs/data/data3/current/BP-1832122356-172.31.14.131-1675918990361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:14,830 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/dfs/data/data4/current/BP-1832122356-172.31.14.131-1675918990361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:14,832 WARN [Listener at localhost/42355] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:14,835 INFO [Listener at localhost/42355] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:14,939 WARN [BP-1832122356-172.31.14.131-1675918990361 heartbeating to localhost/127.0.0.1:45615] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:14,939 WARN [BP-1832122356-172.31.14.131-1675918990361 heartbeating to localhost/127.0.0.1:45615] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1832122356-172.31.14.131-1675918990361 (Datanode Uuid bb392842-ac1b-4b02-8135-47dae8a6365f) service to localhost/127.0.0.1:45615 2023-02-09 05:03:14,939 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/dfs/data/data1/current/BP-1832122356-172.31.14.131-1675918990361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:14,940 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/cluster_c4aca84a-8d73-826b-0a78-1e0c5b421d8a/dfs/data/data2/current/BP-1832122356-172.31.14.131-1675918990361] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:14,949 INFO [Listener at localhost/42355] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:15,063 INFO [Listener at localhost/42355] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:15,083 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:15,099 INFO [Listener at localhost/42355] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 158) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45615 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42983,1675918990932)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:45615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:45615 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:45615 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/42355 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 538) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 282), ProcessCount=167 (was 168), AvailableMemoryMB=3793 (was 3831) 2023-02-09 05:03:15,112 INFO [Listener at localhost/42355] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=167, AvailableMemoryMB=3793 2023-02-09 05:03:15,122 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.log.dir so I do NOT create it in target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b 2023-02-09 05:03:15,123 WARN [Listener at localhost/42355] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.tmp.dir so I do NOT create it in target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b 2023-02-09 05:03:15,123 WARN [Listener at localhost/42355] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fd98adf-6617-7c22-bec4-959bee27bf0b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:15,123 DEBUG [Listener at localhost/42355] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75, deleteOnExit=true 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/test.cache.data in system properties and HBase conf 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:15,123 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:15,124 DEBUG [Listener at localhost/42355] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:15,124 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:15,125 INFO [Listener at localhost/42355] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:15,129 WARN [Listener at localhost/42355] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:15,129 WARN [Listener at localhost/42355] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:15,177 WARN [Listener at localhost/42355] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:15,178 INFO [Listener at localhost/42355] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:15,185 INFO [Listener at localhost/42355] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/java.io.tmpdir/Jetty_localhost_40643_hdfs____.nc6qzh/webapp 2023-02-09 05:03:15,276 INFO [Listener at localhost/42355] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40643 2023-02-09 05:03:15,280 WARN [Listener at localhost/42355] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:15,281 WARN [Listener at localhost/42355] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:15,323 WARN [Listener at localhost/38581] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:15,336 WARN [Listener at localhost/38581] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:15,340 WARN [Listener at localhost/38581] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:15,341 INFO [Listener at localhost/38581] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:15,347 INFO [Listener at localhost/38581] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/java.io.tmpdir/Jetty_localhost_34779_datanode____tb8ain/webapp 2023-02-09 05:03:15,440 INFO [Listener at localhost/38581] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34779 2023-02-09 05:03:15,450 WARN [Listener at localhost/37849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:15,467 WARN [Listener at localhost/37849] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:15,469 WARN [Listener at localhost/37849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:15,470 INFO [Listener at localhost/37849] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:15,474 INFO [Listener at localhost/37849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/java.io.tmpdir/Jetty_localhost_36125_datanode____.4x74x4/webapp 2023-02-09 05:03:15,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x944908160b84c4a8: Processing first storage report for DS-dfd68bab-830c-4167-a092-10fe654de275 from datanode db794d63-7d1c-4391-b04f-b9bfe561d8d8 2023-02-09 05:03:15,541 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x944908160b84c4a8: from storage DS-dfd68bab-830c-4167-a092-10fe654de275 node DatanodeRegistration(127.0.0.1:45961, datanodeUuid=db794d63-7d1c-4391-b04f-b9bfe561d8d8, infoPort=45409, infoSecurePort=0, ipcPort=37849, storageInfo=lv=-57;cid=testClusterID;nsid=14657727;c=1675918995131), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:15,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x944908160b84c4a8: Processing first storage report for DS-17fdedfc-6ec6-4093-ae33-c180877c6ae6 from datanode db794d63-7d1c-4391-b04f-b9bfe561d8d8 2023-02-09 05:03:15,541 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x944908160b84c4a8: from storage DS-17fdedfc-6ec6-4093-ae33-c180877c6ae6 node DatanodeRegistration(127.0.0.1:45961, datanodeUuid=db794d63-7d1c-4391-b04f-b9bfe561d8d8, infoPort=45409, infoSecurePort=0, ipcPort=37849, storageInfo=lv=-57;cid=testClusterID;nsid=14657727;c=1675918995131), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:15,574 INFO [Listener at localhost/37849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36125 2023-02-09 05:03:15,581 WARN [Listener at localhost/37419] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:15,714 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x596014ca9e1ca326: Processing first storage report for DS-defb7cff-ff82-4557-9316-ef9d1b458062 from datanode 89ff46ae-8765-4b7d-b65c-38c9a249466c 2023-02-09 05:03:15,714 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x596014ca9e1ca326: from storage DS-defb7cff-ff82-4557-9316-ef9d1b458062 node DatanodeRegistration(127.0.0.1:36411, datanodeUuid=89ff46ae-8765-4b7d-b65c-38c9a249466c, infoPort=33465, infoSecurePort=0, ipcPort=37419, storageInfo=lv=-57;cid=testClusterID;nsid=14657727;c=1675918995131), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:15,714 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x596014ca9e1ca326: Processing first storage report for DS-61fd8cde-4442-49d2-966d-487866e75989 from datanode 89ff46ae-8765-4b7d-b65c-38c9a249466c 2023-02-09 05:03:15,714 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x596014ca9e1ca326: from storage DS-61fd8cde-4442-49d2-966d-487866e75989 node DatanodeRegistration(127.0.0.1:36411, datanodeUuid=89ff46ae-8765-4b7d-b65c-38c9a249466c, infoPort=33465, infoSecurePort=0, ipcPort=37419, storageInfo=lv=-57;cid=testClusterID;nsid=14657727;c=1675918995131), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:15,732 DEBUG [Listener at localhost/37419] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b 2023-02-09 05:03:15,734 INFO [Listener at localhost/37419] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/zookeeper_0, clientPort=51781, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:15,735 INFO [Listener at localhost/37419] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51781 2023-02-09 05:03:15,735 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,736 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,751 INFO [Listener at localhost/37419] util.FSUtils(479): Created version file at hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c with version=8 2023-02-09 05:03:15,752 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,753 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,754 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/hbase-staging 2023-02-09 05:03:15,756 INFO [Listener at localhost/37419] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:15,756 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,757 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,757 INFO [Listener at localhost/37419] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:15,757 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,757 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:15,757 INFO [Listener at localhost/37419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:15,758 INFO [Listener at localhost/37419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36237 2023-02-09 05:03:15,758 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,759 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,760 INFO [Listener at localhost/37419] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36237 connecting to ZooKeeper ensemble=127.0.0.1:51781 2023-02-09 05:03:15,768 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:362370x0, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:15,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36237-0x10037765ada0000 connected 2023-02-09 05:03:15,789 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:15,790 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:15,790 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:15,792 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36237 2023-02-09 05:03:15,792 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36237 2023-02-09 05:03:15,792 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36237 2023-02-09 05:03:15,792 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36237 2023-02-09 05:03:15,793 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36237 2023-02-09 05:03:15,793 INFO [Listener at localhost/37419] master.HMaster(439): hbase.rootdir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c, hbase.cluster.distributed=false 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:15,805 INFO [Listener at localhost/37419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:15,806 INFO [Listener at localhost/37419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38433 2023-02-09 05:03:15,806 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:15,809 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:15,809 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,810 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,811 INFO [Listener at localhost/37419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38433 connecting to ZooKeeper ensemble=127.0.0.1:51781 2023-02-09 05:03:15,814 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:384330x0, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:15,815 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38433-0x10037765ada0001 connected 2023-02-09 05:03:15,815 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:15,816 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:15,816 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:15,820 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38433 2023-02-09 05:03:15,820 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38433 2023-02-09 05:03:15,820 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38433 2023-02-09 05:03:15,820 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38433 2023-02-09 05:03:15,824 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38433 2023-02-09 05:03:15,834 INFO [Listener at localhost/37419] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:15,835 INFO [Listener at localhost/37419] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:15,836 INFO [Listener at localhost/37419] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33859 2023-02-09 05:03:15,836 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:15,837 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:15,837 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,838 INFO [Listener at localhost/37419] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,839 INFO [Listener at localhost/37419] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33859 connecting to ZooKeeper ensemble=127.0.0.1:51781 2023-02-09 05:03:15,842 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:338590x0, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:15,843 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:338590x0, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:15,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33859-0x10037765ada0002 connected 2023-02-09 05:03:15,844 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:15,844 DEBUG [Listener at localhost/37419] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:15,847 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33859 2023-02-09 05:03:15,847 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33859 2023-02-09 05:03:15,848 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33859 2023-02-09 05:03:15,852 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33859 2023-02-09 05:03:15,852 DEBUG [Listener at localhost/37419] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33859 2023-02-09 05:03:15,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,856 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:15,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,858 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:15,858 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:15,858 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,858 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:15,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:15,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36237,1675918995756 from backup master directory 2023-02-09 05:03:15,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:15,862 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,862 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:15,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,862 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:15,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/hbase.id with ID: 48659b90-4aba-4c71-b37e-ed387cd407c5 2023-02-09 05:03:15,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:15,889 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x17405855 to 127.0.0.1:51781 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:15,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67b0130c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:15,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:15,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:15,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:15,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store-tmp 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:15,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:15,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:15,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675918995915Disabling compacts and flushes for region at 1675918995915Disabling writes for close at 1675918995915Writing region close event to WAL at 1675918995915Closed at 1675918995915 2023-02-09 05:03:15,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/WALs/jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36237%2C1675918995756, suffix=, logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/WALs/jenkins-hbase4.apache.org,36237,1675918995756, archiveDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:15,938 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK] 2023-02-09 05:03:15,938 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK] 2023-02-09 05:03:15,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/WALs/jenkins-hbase4.apache.org,36237,1675918995756/jenkins-hbase4.apache.org%2C36237%2C1675918995756.1675918995918 2023-02-09 05:03:15,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK], DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK]] 2023-02-09 05:03:15,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:15,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:15,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,948 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,949 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:15,949 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:15,950 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:15,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:15,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:15,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61944918, jitterRate=-0.07694879174232483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:15,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675918995945Initializing all the Stores at 1675918995945Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918995945Cleaning up temporary data from old regions at 1675918995951 (+6 ms)Cleaning up detritus from prior splits at 1675918995951Region opened successfully at 1675918995957 (+6 ms) 2023-02-09 05:03:15,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:15,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:15,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:15,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:15,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:15,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:15,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:15,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:15,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:15,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:15,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:15,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:15,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:15,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:15,976 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:15,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:15,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:15,979 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:15,979 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:15,979 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:15,979 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36237,1675918995756, sessionid=0x10037765ada0000, setting cluster-up flag (Was=false) 2023-02-09 05:03:15,983 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:15,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,992 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:15,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:15,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:15,997 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/.tmp 2023-02-09 05:03:15,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:15,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919026005 2023-02-09 05:03:16,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:16,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:16,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:16,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:16,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:16,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:16,006 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:16,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,006 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:16,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:16,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918996007,5,FailOnTimeoutGroup] 2023-02-09 05:03:16,007 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:16,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918996007,5,FailOnTimeoutGroup] 2023-02-09 05:03:16,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:16,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,027 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:16,027 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:16,027 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c 2023-02-09 05:03:16,039 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:16,040 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:16,041 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/info 2023-02-09 05:03:16,041 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:16,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:16,043 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:16,043 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:16,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,043 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:16,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/table 2023-02-09 05:03:16,045 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:16,045 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,046 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740 2023-02-09 05:03:16,046 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740 2023-02-09 05:03:16,048 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:16,049 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:16,051 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62589103, jitterRate=-0.06734968721866608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675918996039Initializing all the Stores at 1675918996039Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918996039Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918996040 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918996040Cleaning up temporary data from old regions at 1675918996047 (+7 ms)Cleaning up detritus from prior splits at 1675918996048 (+1 ms)Region opened successfully at 1675918996051 (+3 ms) 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:16,051 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:16,051 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:16,052 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:16,052 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675918996051Disabling compacts and flushes for region at 1675918996051Disabling writes for close at 1675918996051Writing region close event to WAL at 1675918996052 (+1 ms)Closed at 1675918996052 2023-02-09 05:03:16,053 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:16,053 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:16,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:16,053 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(952): ClusterId : 48659b90-4aba-4c71-b37e-ed387cd407c5 2023-02-09 05:03:16,053 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:16,056 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:16,056 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:16,057 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:16,058 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:16,059 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(952): ClusterId : 48659b90-4aba-4c71-b37e-ed387cd407c5 2023-02-09 05:03:16,059 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:16,060 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:16,061 DEBUG [RS:0;jenkins-hbase4:38433] zookeeper.ReadOnlyZKClient(139): Connect 0x32c5a4cc to 127.0.0.1:51781 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:16,062 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:16,062 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:16,063 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:16,065 DEBUG [RS:1;jenkins-hbase4:33859] zookeeper.ReadOnlyZKClient(139): Connect 0x0e8c6183 to 127.0.0.1:51781 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:16,068 DEBUG [RS:0;jenkins-hbase4:38433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c024ce4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:16,069 DEBUG [RS:1;jenkins-hbase4:33859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b9e22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:16,069 DEBUG [RS:0;jenkins-hbase4:38433] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@383dcfbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:16,069 DEBUG [RS:1;jenkins-hbase4:33859] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4740af3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:16,077 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38433 2023-02-09 05:03:16,077 INFO [RS:0;jenkins-hbase4:38433] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:16,077 INFO [RS:0;jenkins-hbase4:38433] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:16,077 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:16,078 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36237,1675918995756 with isa=jenkins-hbase4.apache.org/172.31.14.131:38433, startcode=1675918995805 2023-02-09 05:03:16,078 DEBUG [RS:0;jenkins-hbase4:38433] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:16,079 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33859 2023-02-09 05:03:16,079 INFO [RS:1;jenkins-hbase4:33859] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:16,079 INFO [RS:1;jenkins-hbase4:33859] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:16,079 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:16,079 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36237,1675918995756 with isa=jenkins-hbase4.apache.org/172.31.14.131:33859, startcode=1675918995834 2023-02-09 05:03:16,079 DEBUG [RS:1;jenkins-hbase4:33859] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:16,080 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49455, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:16,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,082 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45913, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:16,082 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c 2023-02-09 05:03:16,082 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38581 2023-02-09 05:03:16,082 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:16,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,083 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c 2023-02-09 05:03:16,083 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38581 2023-02-09 05:03:16,083 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:16,084 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:16,088 DEBUG [RS:0;jenkins-hbase4:38433] zookeeper.ZKUtil(162): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,088 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38433,1675918995805] 2023-02-09 05:03:16,088 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33859,1675918995834] 2023-02-09 05:03:16,088 WARN [RS:0;jenkins-hbase4:38433] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:16,088 DEBUG [RS:1;jenkins-hbase4:33859] zookeeper.ZKUtil(162): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,088 INFO [RS:0;jenkins-hbase4:38433] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:16,088 WARN [RS:1;jenkins-hbase4:33859] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:16,088 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,088 INFO [RS:1;jenkins-hbase4:33859] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:16,088 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,095 DEBUG [RS:0;jenkins-hbase4:38433] zookeeper.ZKUtil(162): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,095 DEBUG [RS:1;jenkins-hbase4:33859] zookeeper.ZKUtil(162): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,096 DEBUG [RS:0;jenkins-hbase4:38433] zookeeper.ZKUtil(162): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,096 DEBUG [RS:1;jenkins-hbase4:33859] zookeeper.ZKUtil(162): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,096 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:16,096 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:16,097 INFO [RS:0;jenkins-hbase4:38433] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:16,097 INFO [RS:1;jenkins-hbase4:33859] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:16,100 INFO [RS:0;jenkins-hbase4:38433] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:16,100 INFO [RS:1;jenkins-hbase4:33859] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:16,104 INFO [RS:0;jenkins-hbase4:38433] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:16,104 INFO [RS:1;jenkins-hbase4:33859] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:16,104 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,104 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,104 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:16,104 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:16,106 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,106 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,106 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:1;jenkins-hbase4:33859] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,107 DEBUG [RS:0;jenkins-hbase4:38433] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:16,110 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,110 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,110 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,112 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,112 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,112 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,122 INFO [RS:1;jenkins-hbase4:33859] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:16,123 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33859,1675918995834-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,123 INFO [RS:0;jenkins-hbase4:38433] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:16,124 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38433,1675918995805-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,134 INFO [RS:1;jenkins-hbase4:33859] regionserver.Replication(203): jenkins-hbase4.apache.org,33859,1675918995834 started 2023-02-09 05:03:16,134 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33859,1675918995834, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33859, sessionid=0x10037765ada0002 2023-02-09 05:03:16,134 INFO [RS:0;jenkins-hbase4:38433] regionserver.Replication(203): jenkins-hbase4.apache.org,38433,1675918995805 started 2023-02-09 05:03:16,134 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:16,134 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38433,1675918995805, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38433, sessionid=0x10037765ada0001 2023-02-09 05:03:16,134 DEBUG [RS:1;jenkins-hbase4:33859] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,134 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:16,134 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33859,1675918995834' 2023-02-09 05:03:16,134 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:16,134 DEBUG [RS:0;jenkins-hbase4:38433] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,134 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38433,1675918995805' 2023-02-09 05:03:16,134 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38433,1675918995805' 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33859,1675918995834' 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:16,135 DEBUG [RS:0;jenkins-hbase4:38433] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:16,135 DEBUG [RS:1;jenkins-hbase4:33859] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:16,136 DEBUG [RS:0;jenkins-hbase4:38433] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:16,136 INFO [RS:0;jenkins-hbase4:38433] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:16,136 INFO [RS:0;jenkins-hbase4:38433] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:16,136 DEBUG [RS:1;jenkins-hbase4:33859] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:16,136 INFO [RS:1;jenkins-hbase4:33859] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:16,136 INFO [RS:1;jenkins-hbase4:33859] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:16,208 DEBUG [jenkins-hbase4:36237] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:16,209 DEBUG [jenkins-hbase4:36237] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:16,210 DEBUG [jenkins-hbase4:36237] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:16,211 DEBUG [jenkins-hbase4:36237] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:16,211 DEBUG [jenkins-hbase4:36237] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:16,212 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38433,1675918995805, state=OPENING 2023-02-09 05:03:16,213 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:16,214 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:16,215 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:16,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:16,369 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:16,369 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:16,371 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34490, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:16,376 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:16,376 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:16,377 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38433%2C1675918995805.meta, suffix=.meta, logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,38433,1675918995805, archiveDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs, maxLogs=32 2023-02-09 05:03:16,395 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK] 2023-02-09 05:03:16,395 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK] 2023-02-09 05:03:16,397 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,38433,1675918995805/jenkins-hbase4.apache.org%2C38433%2C1675918995805.meta.1675918996378.meta 2023-02-09 05:03:16,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK], DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK]] 2023-02-09 05:03:16,397 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:16,398 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:16,398 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:16,400 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:16,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/info 2023-02-09 05:03:16,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/info 2023-02-09 05:03:16,401 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:16,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,402 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:16,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:16,402 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:16,403 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:16,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,403 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:16,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/table 2023-02-09 05:03:16,404 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/table 2023-02-09 05:03:16,404 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:16,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740 2023-02-09 05:03:16,406 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740 2023-02-09 05:03:16,409 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:16,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:16,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71952790, jitterRate=0.0721801221370697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:16,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675918996398Writing region info on filesystem at 1675918996398Initializing all the Stores at 1675918996399 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918996399Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918996400 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918996400Cleaning up temporary data from old regions at 1675918996408 (+8 ms)Cleaning up detritus from prior splits at 1675918996408Running coprocessor post-open hooks at 1675918996411 (+3 ms)Region opened successfully at 1675918996411 2023-02-09 05:03:16,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675918996369 2023-02-09 05:03:16,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:16,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:16,418 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38433,1675918995805, state=OPEN 2023-02-09 05:03:16,419 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:16,419 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:16,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:16,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38433,1675918995805 in 204 msec 2023-02-09 05:03:16,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:16,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 367 msec 2023-02-09 05:03:16,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 424 msec 2023-02-09 05:03:16,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675918995856, completionTime=-1 2023-02-09 05:03:16,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:16,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:16,427 DEBUG [hconnection-0x2e571495-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:16,429 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:16,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:16,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919056431 2023-02-09 05:03:16,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919116431 2023-02-09 05:03:16,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-09 05:03:16,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36237,1675918995756-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36237,1675918995756-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36237,1675918995756-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36237, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:16,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:16,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:16,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:16,440 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:16,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:16,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:16,442 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,442 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc empty. 2023-02-09 05:03:16,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,443 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:16,461 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:16,463 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b8cf61d93c608ed5a1645330581be4cc, NAME => 'hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:16,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:16,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b8cf61d93c608ed5a1645330581be4cc, disabling compactions & flushes 2023-02-09 05:03:16,475 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,475 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. after waiting 0 ms 2023-02-09 05:03:16,476 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,476 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,476 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b8cf61d93c608ed5a1645330581be4cc: Waiting for close lock at 1675918996475Disabling compacts and flushes for region at 1675918996475Disabling writes for close at 1675918996475Writing region close event to WAL at 1675918996476 (+1 ms)Closed at 1675918996476 2023-02-09 05:03:16,479 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:16,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918996480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918996480"}]},"ts":"1675918996480"} 2023-02-09 05:03:16,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:16,483 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:16,484 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918996484"}]},"ts":"1675918996484"} 2023-02-09 05:03:16,485 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:16,488 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:16,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:16,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:16,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:16,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b8cf61d93c608ed5a1645330581be4cc, ASSIGN}] 2023-02-09 05:03:16,496 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b8cf61d93c608ed5a1645330581be4cc, ASSIGN 2023-02-09 05:03:16,497 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b8cf61d93c608ed5a1645330581be4cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:16,647 INFO [jenkins-hbase4:36237] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:16,648 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b8cf61d93c608ed5a1645330581be4cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,649 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918996648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918996648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918996648"}]},"ts":"1675918996648"} 2023-02-09 05:03:16,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b8cf61d93c608ed5a1645330581be4cc, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:16,804 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,804 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:16,805 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58470, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:16,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,812 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33859%2C1675918995834, suffix=, logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,33859,1675918995834, archiveDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs, maxLogs=32 2023-02-09 05:03:16,826 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK] 2023-02-09 05:03:16,826 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK] 2023-02-09 05:03:16,828 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,33859,1675918995834/jenkins-hbase4.apache.org%2C33859%2C1675918995834.1675918996813 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK], DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK]] 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b8cf61d93c608ed5a1645330581be4cc, NAME => 'hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,829 INFO [StoreOpener-b8cf61d93c608ed5a1645330581be4cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,831 DEBUG [StoreOpener-b8cf61d93c608ed5a1645330581be4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/info 2023-02-09 05:03:16,831 DEBUG [StoreOpener-b8cf61d93c608ed5a1645330581be4cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/info 2023-02-09 05:03:16,831 INFO [StoreOpener-b8cf61d93c608ed5a1645330581be4cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8cf61d93c608ed5a1645330581be4cc columnFamilyName info 2023-02-09 05:03:16,831 INFO [StoreOpener-b8cf61d93c608ed5a1645330581be4cc-1] regionserver.HStore(310): Store=b8cf61d93c608ed5a1645330581be4cc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:16,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,832 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:16,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:16,839 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b8cf61d93c608ed5a1645330581be4cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63911938, jitterRate=-0.04763790965080261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:16,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b8cf61d93c608ed5a1645330581be4cc: Running coprocessor pre-open hook at 1675918996828Writing region info on filesystem at 1675918996828Initializing all the Stores at 1675918996829 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675918996829Cleaning up temporary data from old regions at 1675918996833 (+4 ms)Cleaning up detritus from prior splits at 1675918996833Running coprocessor post-open hooks at 1675918996839 (+6 ms)Region opened successfully at 1675918996839 2023-02-09 05:03:16,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc., pid=6, masterSystemTime=1675918996804 2023-02-09 05:03:16,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,843 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:16,843 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b8cf61d93c608ed5a1645330581be4cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:16,844 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675918996843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918996843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918996843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918996843"}]},"ts":"1675918996843"} 2023-02-09 05:03:16,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:16,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b8cf61d93c608ed5a1645330581be4cc, server=jenkins-hbase4.apache.org,33859,1675918995834 in 195 msec 2023-02-09 05:03:16,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:16,848 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b8cf61d93c608ed5a1645330581be4cc, ASSIGN in 357 msec 2023-02-09 05:03:16,848 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:16,849 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918996848"}]},"ts":"1675918996848"} 2023-02-09 05:03:16,850 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:16,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:16,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 414 msec 2023-02-09 05:03:16,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:16,941 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:16,941 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:16,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:16,944 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:16,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:16,955 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:16,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-09 05:03:16,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:16,965 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:16,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 05:03:16,971 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:16,974 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:16,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.112sec 2023-02-09 05:03:16,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:16,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:16,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:16,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36237,1675918995756-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:16,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36237,1675918995756-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:16,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:17,058 DEBUG [Listener at localhost/37419] zookeeper.ReadOnlyZKClient(139): Connect 0x0af21ea9 to 127.0.0.1:51781 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:17,063 DEBUG [Listener at localhost/37419] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a09861f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:17,064 DEBUG [hconnection-0x5666649a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:17,066 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34516, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:17,067 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:17,068 DEBUG [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:17,068 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,068 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,069 DEBUG [Listener at localhost/37419] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:17,071 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:17,073 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:17,074 INFO [Listener at localhost/37419] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 05:03:17,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 05:03:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:17,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:52102 deadline: 1675919057074, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-09 05:03:17,076 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-09 05:03:17,076 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,076 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:17,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:17,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:17,085 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:17,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-09 05:03:17,085 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,086 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:17,086 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:17,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:17,098 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 empty. 2023-02-09 05:03:17,099 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 empty. 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd empty. 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab empty. 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d empty. 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,100 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee empty. 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f empty. 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d empty. 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 empty. 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,101 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 empty. 2023-02-09 05:03:17,102 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 05:03:17,125 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:17,126 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 122f54af406924ee1baa6592304c4679, NAME => 'testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,127 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 33a7cf02a27c06f47fa4bfe393f8b21d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,127 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0474cd6ce4681a15c755d0effff737ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,139 INFO [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38433%2C1675918995805, suffix=, logDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,38433,1675918995805, archiveDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs, maxLogs=32 2023-02-09 05:03:17,158 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK] 2023-02-09 05:03:17,158 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK] 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 122f54af406924ee1baa6592304c4679, disabling compactions & flushes 2023-02-09 05:03:17,162 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. after waiting 0 ms 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,162 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,162 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 122f54af406924ee1baa6592304c4679: Waiting for close lock at 1675918997162Disabling compacts and flushes for region at 1675918997162Disabling writes for close at 1675918997162Writing region close event to WAL at 1675918997162Closed at 1675918997162 2023-02-09 05:03:17,170 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 432ad7357ee1ec322c688cf46abcb9cd, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,170 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,170 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 33a7cf02a27c06f47fa4bfe393f8b21d, disabling compactions & flushes 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 0474cd6ce4681a15c755d0effff737ab, disabling compactions & flushes 2023-02-09 05:03:17,171 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. after waiting 0 ms 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,171 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,171 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Waiting for close lock at 1675918997171Disabling compacts and flushes for region at 1675918997171Disabling writes for close at 1675918997171Writing region close event to WAL at 1675918997171Closed at 1675918997171 2023-02-09 05:03:17,171 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,172 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. after waiting 0 ms 2023-02-09 05:03:17,172 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9ff8c4b092cda73a08d1b1c24c4e7f91, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,172 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,172 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,172 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 0474cd6ce4681a15c755d0effff737ab: Waiting for close lock at 1675918997171Disabling compacts and flushes for region at 1675918997171Disabling writes for close at 1675918997172 (+1 ms)Writing region close event to WAL at 1675918997172Closed at 1675918997172 2023-02-09 05:03:17,172 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3bad2a73089572ab0abab2298d19d65f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,173 INFO [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/WALs/jenkins-hbase4.apache.org,38433,1675918995805/jenkins-hbase4.apache.org%2C38433%2C1675918995805.1675918997139 2023-02-09 05:03:17,176 DEBUG [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36411,DS-defb7cff-ff82-4557-9316-ef9d1b458062,DISK], DatanodeInfoWithStorage[127.0.0.1:45961,DS-dfd68bab-830c-4167-a092-10fe654de275,DISK]] 2023-02-09 05:03:17,187 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,187 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:17,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:17,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 3bad2a73089572ab0abab2298d19d65f, disabling compactions & flushes 2023-02-09 05:03:17,200 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. after waiting 0 ms 2023-02-09 05:03:17,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,201 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,201 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 3bad2a73089572ab0abab2298d19d65f: Waiting for close lock at 1675918997200Disabling compacts and flushes for region at 1675918997200Disabling writes for close at 1675918997200Writing region close event to WAL at 1675918997201 (+1 ms)Closed at 1675918997201 2023-02-09 05:03:17,201 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => bc4eb96e00c3268767f2496010e195ee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,204 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 432ad7357ee1ec322c688cf46abcb9cd, disabling compactions & flushes 2023-02-09 05:03:17,205 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. after waiting 0 ms 2023-02-09 05:03:17,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,205 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,205 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 432ad7357ee1ec322c688cf46abcb9cd: Waiting for close lock at 1675918997205Disabling compacts and flushes for region at 1675918997205Disabling writes for close at 1675918997205Writing region close event to WAL at 1675918997205Closed at 1675918997205 2023-02-09 05:03:17,205 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 93e6cca95845a69da56c80153f65963d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 9ff8c4b092cda73a08d1b1c24c4e7f91, disabling compactions & flushes 2023-02-09 05:03:17,210 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. after waiting 0 ms 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,210 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,210 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Waiting for close lock at 1675918997210Disabling compacts and flushes for region at 1675918997210Disabling writes for close at 1675918997210Writing region close event to WAL at 1675918997210Closed at 1675918997210 2023-02-09 05:03:17,211 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 67e78fe7a85e34ecc9e1d7aed8e1dbd6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing bc4eb96e00c3268767f2496010e195ee, disabling compactions & flushes 2023-02-09 05:03:17,222 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. after waiting 0 ms 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,222 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,222 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for bc4eb96e00c3268767f2496010e195ee: Waiting for close lock at 1675918997222Disabling compacts and flushes for region at 1675918997222Disabling writes for close at 1675918997222Writing region close event to WAL at 1675918997222Closed at 1675918997222 2023-02-09 05:03:17,223 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 02c9246320a746fdd379e09775311b81, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 93e6cca95845a69da56c80153f65963d, disabling compactions & flushes 2023-02-09 05:03:17,237 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. after waiting 0 ms 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,237 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,237 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 93e6cca95845a69da56c80153f65963d: Waiting for close lock at 1675918997237Disabling compacts and flushes for region at 1675918997237Disabling writes for close at 1675918997237Writing region close event to WAL at 1675918997237Closed at 1675918997237 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 67e78fe7a85e34ecc9e1d7aed8e1dbd6, disabling compactions & flushes 2023-02-09 05:03:17,238 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. after waiting 0 ms 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,238 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,238 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Waiting for close lock at 1675918997238Disabling compacts and flushes for region at 1675918997238Disabling writes for close at 1675918997238Writing region close event to WAL at 1675918997238Closed at 1675918997238 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 02c9246320a746fdd379e09775311b81, disabling compactions & flushes 2023-02-09 05:03:17,242 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. after waiting 0 ms 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,242 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 02c9246320a746fdd379e09775311b81: Waiting for close lock at 1675918997242Disabling compacts and flushes for region at 1675918997242Disabling writes for close at 1675918997242Writing region close event to WAL at 1675918997242Closed at 1675918997242 2023-02-09 05:03:17,245 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:17,245 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675918997245"}]},"ts":"1675918997245"} 2023-02-09 05:03:17,248 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-09 05:03:17,249 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:17,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918997249"}]},"ts":"1675918997249"} 2023-02-09 05:03:17,250 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-09 05:03:17,254 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:17,259 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:17,259 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:17,259 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:17,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, ASSIGN}] 2023-02-09 05:03:17,261 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, ASSIGN 2023-02-09 05:03:17,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, ASSIGN 2023-02-09 05:03:17,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, ASSIGN 2023-02-09 05:03:17,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, ASSIGN 2023-02-09 05:03:17,262 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38433,1675918995805; forceNewPlan=false, retain=false 2023-02-09 05:03:17,263 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:17,263 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:17,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, ASSIGN 2023-02-09 05:03:17,263 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38433,1675918995805; forceNewPlan=false, retain=false 2023-02-09 05:03:17,263 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, ASSIGN 2023-02-09 05:03:17,264 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, ASSIGN 2023-02-09 05:03:17,264 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:17,264 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, ASSIGN 2023-02-09 05:03:17,264 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38433,1675918995805; forceNewPlan=false, retain=false 2023-02-09 05:03:17,264 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:17,264 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38433,1675918995805; forceNewPlan=false, retain=false 2023-02-09 05:03:17,265 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, ASSIGN 2023-02-09 05:03:17,265 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, ASSIGN 2023-02-09 05:03:17,265 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38433,1675918995805; forceNewPlan=false, retain=false 2023-02-09 05:03:17,266 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33859,1675918995834; forceNewPlan=false, retain=false 2023-02-09 05:03:17,389 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,389 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:17,413 INFO [jenkins-hbase4:36237] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-09 05:03:17,419 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3bad2a73089572ab0abab2298d19d65f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=02c9246320a746fdd379e09775311b81, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=93e6cca95845a69da56c80153f65963d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,419 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=33a7cf02a27c06f47fa4bfe393f8b21d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=9ff8c4b092cda73a08d1b1c24c4e7f91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997419"}]},"ts":"1675918997419"} 2023-02-09 05:03:17,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997419"}]},"ts":"1675918997419"} 2023-02-09 05:03:17,419 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997419"}]},"ts":"1675918997419"} 2023-02-09 05:03:17,419 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997419"}]},"ts":"1675918997419"} 2023-02-09 05:03:17,419 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997419"}]},"ts":"1675918997419"} 2023-02-09 05:03:17,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 02c9246320a746fdd379e09775311b81, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:17,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 93e6cca95845a69da56c80153f65963d, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:17,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=15, state=RUNNABLE; OpenRegionProcedure 9ff8c4b092cda73a08d1b1c24c4e7f91, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:17,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 3bad2a73089572ab0abab2298d19d65f, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:17,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bc4eb96e00c3268767f2496010e195ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 33a7cf02a27c06f47fa4bfe393f8b21d, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:17,428 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997427"}]},"ts":"1675918997427"} 2023-02-09 05:03:17,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=122f54af406924ee1baa6592304c4679, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,428 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997428"}]},"ts":"1675918997428"} 2023-02-09 05:03:17,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0474cd6ce4681a15c755d0effff737ab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997429"}]},"ts":"1675918997429"} 2023-02-09 05:03:17,429 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=432ad7357ee1ec322c688cf46abcb9cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997429"}]},"ts":"1675918997429"} 2023-02-09 05:03:17,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure bc4eb96e00c3268767f2496010e195ee, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:17,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=67e78fe7a85e34ecc9e1d7aed8e1dbd6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675918997430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675918997430"}]},"ts":"1675918997430"} 2023-02-09 05:03:17,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 122f54af406924ee1baa6592304c4679, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:17,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 0474cd6ce4681a15c755d0effff737ab, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:17,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 432ad7357ee1ec322c688cf46abcb9cd, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:17,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=19, state=RUNNABLE; OpenRegionProcedure 67e78fe7a85e34ecc9e1d7aed8e1dbd6, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:17,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02c9246320a746fdd379e09775311b81, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-09 05:03:17,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,578 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,580 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f1 2023-02-09 05:03:17,580 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f1 2023-02-09 05:03:17,580 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02c9246320a746fdd379e09775311b81 columnFamilyName f1 2023-02-09 05:03:17,580 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(310): Store=02c9246320a746fdd379e09775311b81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,581 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,582 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f2 2023-02-09 05:03:17,582 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f2 2023-02-09 05:03:17,582 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02c9246320a746fdd379e09775311b81 columnFamilyName f2 2023-02-09 05:03:17,583 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(310): Store=02c9246320a746fdd379e09775311b81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 122f54af406924ee1baa6592304c4679, NAME => 'testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,585 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,586 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f1 2023-02-09 05:03:17,586 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f1 2023-02-09 05:03:17,587 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 122f54af406924ee1baa6592304c4679 columnFamilyName f1 2023-02-09 05:03:17,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:17,587 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(310): Store=122f54af406924ee1baa6592304c4679/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,587 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,589 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f2 2023-02-09 05:03:17,589 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f2 2023-02-09 05:03:17,589 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 122f54af406924ee1baa6592304c4679 columnFamilyName f2 2023-02-09 05:03:17,589 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(310): Store=122f54af406924ee1baa6592304c4679/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 02c9246320a746fdd379e09775311b81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74505081, jitterRate=0.11021222174167633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 02c9246320a746fdd379e09775311b81: Running coprocessor pre-open hook at 1675918997577Writing region info on filesystem at 1675918997577Initializing all the Stores at 1675918997578 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997578Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997578Cleaning up temporary data from old regions at 1675918997585 (+7 ms)Cleaning up detritus from prior splits at 1675918997585Running coprocessor post-open hooks at 1675918997597 (+12 ms)Region opened successfully at 1675918997597 2023-02-09 05:03:17,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81., pid=21, masterSystemTime=1675918997573 2023-02-09 05:03:17,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:17,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3bad2a73089572ab0abab2298d19d65f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-09 05:03:17,600 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=02c9246320a746fdd379e09775311b81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,600 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997600"}]},"ts":"1675918997600"} 2023-02-09 05:03:17,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:17,601 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,603 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1 2023-02-09 05:03:17,603 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1 2023-02-09 05:03:17,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-09 05:03:17,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 02c9246320a746fdd379e09775311b81, server=jenkins-hbase4.apache.org,38433,1675918995805 in 180 msec 2023-02-09 05:03:17,603 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bad2a73089572ab0abab2298d19d65f columnFamilyName f1 2023-02-09 05:03:17,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 122f54af406924ee1baa6592304c4679; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66768608, jitterRate=-0.005070209503173828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 122f54af406924ee1baa6592304c4679: Running coprocessor pre-open hook at 1675918997584Writing region info on filesystem at 1675918997584Initializing all the Stores at 1675918997585 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997585Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997585Cleaning up temporary data from old regions at 1675918997597 (+12 ms)Cleaning up detritus from prior splits at 1675918997598 (+1 ms)Running coprocessor post-open hooks at 1675918997603 (+5 ms)Region opened successfully at 1675918997603 2023-02-09 05:03:17,604 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(310): Store=3bad2a73089572ab0abab2298d19d65f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,604 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, ASSIGN in 344 msec 2023-02-09 05:03:17,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679., pid=27, masterSystemTime=1675918997581 2023-02-09 05:03:17,605 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2 2023-02-09 05:03:17,605 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2 2023-02-09 05:03:17,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:17,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,606 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bad2a73089572ab0abab2298d19d65f columnFamilyName f2 2023-02-09 05:03:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 432ad7357ee1ec322c688cf46abcb9cd, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-09 05:03:17,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=122f54af406924ee1baa6592304c4679, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675918997606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997606"}]},"ts":"1675918997606"} 2023-02-09 05:03:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,606 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(310): Store=3bad2a73089572ab0abab2298d19d65f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,607 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,609 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1 2023-02-09 05:03:17,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-09 05:03:17,609 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1 2023-02-09 05:03:17,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 122f54af406924ee1baa6592304c4679, server=jenkins-hbase4.apache.org,33859,1675918995834 in 177 msec 2023-02-09 05:03:17,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,609 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 432ad7357ee1ec322c688cf46abcb9cd columnFamilyName f1 2023-02-09 05:03:17,610 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(310): Store=432ad7357ee1ec322c688cf46abcb9cd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,610 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, ASSIGN in 350 msec 2023-02-09 05:03:17,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:17,611 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2 2023-02-09 05:03:17,611 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2 2023-02-09 05:03:17,611 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 432ad7357ee1ec322c688cf46abcb9cd columnFamilyName f2 2023-02-09 05:03:17,612 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(310): Store=432ad7357ee1ec322c688cf46abcb9cd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3bad2a73089572ab0abab2298d19d65f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58757324, jitterRate=-0.12444764375686646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3bad2a73089572ab0abab2298d19d65f: Running coprocessor pre-open hook at 1675918997600Writing region info on filesystem at 1675918997600Initializing all the Stores at 1675918997601 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997601Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997601Cleaning up temporary data from old regions at 1675918997608 (+7 ms)Cleaning up detritus from prior splits at 1675918997608Running coprocessor post-open hooks at 1675918997613 (+5 ms)Region opened successfully at 1675918997613 2023-02-09 05:03:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f., pid=24, masterSystemTime=1675918997573 2023-02-09 05:03:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:17,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9ff8c4b092cda73a08d1b1c24c4e7f91, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-09 05:03:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,615 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3bad2a73089572ab0abab2298d19d65f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,615 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997615"}]},"ts":"1675918997615"} 2023-02-09 05:03:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-09 05:03:17,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 3bad2a73089572ab0abab2298d19d65f, server=jenkins-hbase4.apache.org,38433,1675918995805 in 194 msec 2023-02-09 05:03:17,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, ASSIGN in 360 msec 2023-02-09 05:03:17,624 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 432ad7357ee1ec322c688cf46abcb9cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62472207, jitterRate=-0.06909157335758209}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 432ad7357ee1ec322c688cf46abcb9cd: Running coprocessor pre-open hook at 1675918997606Writing region info on filesystem at 1675918997606Initializing all the Stores at 1675918997607 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997607Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997607Cleaning up temporary data from old regions at 1675918997614 (+7 ms)Cleaning up detritus from prior splits at 1675918997614Running coprocessor post-open hooks at 1675918997625 (+11 ms)Region opened successfully at 1675918997625 2023-02-09 05:03:17,625 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1 2023-02-09 05:03:17,625 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1 2023-02-09 05:03:17,625 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff8c4b092cda73a08d1b1c24c4e7f91 columnFamilyName f1 2023-02-09 05:03:17,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd., pid=29, masterSystemTime=1675918997581 2023-02-09 05:03:17,626 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(310): Store=9ff8c4b092cda73a08d1b1c24c4e7f91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,626 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,627 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=432ad7357ee1ec322c688cf46abcb9cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997627"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997627"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997627"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997627"}]},"ts":"1675918997627"} 2023-02-09 05:03:17,628 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2 2023-02-09 05:03:17,628 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2 2023-02-09 05:03:17,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:17,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc4eb96e00c3268767f2496010e195ee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-09 05:03:17,628 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff8c4b092cda73a08d1b1c24c4e7f91 columnFamilyName f2 2023-02-09 05:03:17,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,629 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(310): Store=9ff8c4b092cda73a08d1b1c24c4e7f91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-09 05:03:17,630 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 432ad7357ee1ec322c688cf46abcb9cd, server=jenkins-hbase4.apache.org,33859,1675918995834 in 197 msec 2023-02-09 05:03:17,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, ASSIGN in 371 msec 2023-02-09 05:03:17,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:17,635 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9ff8c4b092cda73a08d1b1c24c4e7f91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68189261, jitterRate=0.016099169850349426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Running coprocessor pre-open hook at 1675918997617Writing region info on filesystem at 1675918997617Initializing all the Stores at 1675918997618 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997618Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997624 (+6 ms)Cleaning up temporary data from old regions at 1675918997630 (+6 ms)Cleaning up detritus from prior splits at 1675918997631 (+1 ms)Running coprocessor post-open hooks at 1675918997636 (+5 ms)Region opened successfully at 1675918997636 2023-02-09 05:03:17,636 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1 2023-02-09 05:03:17,636 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1 2023-02-09 05:03:17,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91., pid=23, masterSystemTime=1675918997573 2023-02-09 05:03:17,637 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc4eb96e00c3268767f2496010e195ee columnFamilyName f1 2023-02-09 05:03:17,637 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(310): Store=bc4eb96e00c3268767f2496010e195ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,637 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:17,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 93e6cca95845a69da56c80153f65963d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-09 05:03:17,638 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=9ff8c4b092cda73a08d1b1c24c4e7f91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,639 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997638"}]},"ts":"1675918997638"} 2023-02-09 05:03:17,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,639 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2 2023-02-09 05:03:17,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,639 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2 2023-02-09 05:03:17,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,639 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc4eb96e00c3268767f2496010e195ee columnFamilyName f2 2023-02-09 05:03:17,640 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(310): Store=bc4eb96e00c3268767f2496010e195ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,640 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=15 2023-02-09 05:03:17,641 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1 2023-02-09 05:03:17,641 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1 2023-02-09 05:03:17,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=15, state=SUCCESS; OpenRegionProcedure 9ff8c4b092cda73a08d1b1c24c4e7f91, server=jenkins-hbase4.apache.org,38433,1675918995805 in 218 msec 2023-02-09 05:03:17,642 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6cca95845a69da56c80153f65963d columnFamilyName f1 2023-02-09 05:03:17,642 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(310): Store=93e6cca95845a69da56c80153f65963d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,642 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, ASSIGN in 382 msec 2023-02-09 05:03:17,644 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2 2023-02-09 05:03:17,644 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2 2023-02-09 05:03:17,644 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6cca95845a69da56c80153f65963d columnFamilyName f2 2023-02-09 05:03:17,645 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(310): Store=93e6cca95845a69da56c80153f65963d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:17,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:17,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc4eb96e00c3268767f2496010e195ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73887111, jitterRate=0.1010037511587143}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc4eb96e00c3268767f2496010e195ee: Running coprocessor pre-open hook at 1675918997629Writing region info on filesystem at 1675918997629Initializing all the Stores at 1675918997630 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997630Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997635 (+5 ms)Cleaning up temporary data from old regions at 1675918997642 (+7 ms)Cleaning up detritus from prior splits at 1675918997642Running coprocessor post-open hooks at 1675918997649 (+7 ms)Region opened successfully at 1675918997649 2023-02-09 05:03:17,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee., pid=26, masterSystemTime=1675918997581 2023-02-09 05:03:17,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:17,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 93e6cca95845a69da56c80153f65963d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62697866, jitterRate=-0.06572899222373962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,651 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bc4eb96e00c3268767f2496010e195ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 93e6cca95845a69da56c80153f65963d: Running coprocessor pre-open hook at 1675918997639Writing region info on filesystem at 1675918997639Initializing all the Stores at 1675918997640 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997640Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997640Cleaning up temporary data from old regions at 1675918997646 (+6 ms)Cleaning up detritus from prior splits at 1675918997647 (+1 ms)Running coprocessor post-open hooks at 1675918997651 (+4 ms)Region opened successfully at 1675918997651 2023-02-09 05:03:17,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0474cd6ce4681a15c755d0effff737ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-09 05:03:17,652 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997651"}]},"ts":"1675918997651"} 2023-02-09 05:03:17,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d., pid=22, masterSystemTime=1675918997573 2023-02-09 05:03:17,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:17,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 33a7cf02a27c06f47fa4bfe393f8b21d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=93e6cca95845a69da56c80153f65963d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,655 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997654"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997654"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997654"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997654"}]},"ts":"1675918997654"} 2023-02-09 05:03:17,655 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,656 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,657 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1 2023-02-09 05:03:17,657 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1 2023-02-09 05:03:17,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-09 05:03:17,657 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure bc4eb96e00c3268767f2496010e195ee, server=jenkins-hbase4.apache.org,33859,1675918995834 in 223 msec 2023-02-09 05:03:17,657 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0474cd6ce4681a15c755d0effff737ab columnFamilyName f1 2023-02-09 05:03:17,658 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(310): Store=0474cd6ce4681a15c755d0effff737ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,658 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1 2023-02-09 05:03:17,658 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, ASSIGN in 398 msec 2023-02-09 05:03:17,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-09 05:03:17,658 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1 2023-02-09 05:03:17,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 93e6cca95845a69da56c80153f65963d, server=jenkins-hbase4.apache.org,38433,1675918995805 in 234 msec 2023-02-09 05:03:17,659 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33a7cf02a27c06f47fa4bfe393f8b21d columnFamilyName f1 2023-02-09 05:03:17,659 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(310): Store=33a7cf02a27c06f47fa4bfe393f8b21d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,660 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, ASSIGN in 399 msec 2023-02-09 05:03:17,661 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2 2023-02-09 05:03:17,661 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2 2023-02-09 05:03:17,661 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33a7cf02a27c06f47fa4bfe393f8b21d columnFamilyName f2 2023-02-09 05:03:17,661 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(310): Store=33a7cf02a27c06f47fa4bfe393f8b21d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,664 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2 2023-02-09 05:03:17,665 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2 2023-02-09 05:03:17,665 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0474cd6ce4681a15c755d0effff737ab columnFamilyName f2 2023-02-09 05:03:17,665 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(310): Store=0474cd6ce4681a15c755d0effff737ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:17,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 33a7cf02a27c06f47fa4bfe393f8b21d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64653169, jitterRate=-0.03659270703792572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Running coprocessor pre-open hook at 1675918997654Writing region info on filesystem at 1675918997654Initializing all the Stores at 1675918997655 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997655Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997656 (+1 ms)Cleaning up temporary data from old regions at 1675918997663 (+7 ms)Cleaning up detritus from prior splits at 1675918997663Running coprocessor post-open hooks at 1675918997671 (+8 ms)Region opened successfully at 1675918997671 2023-02-09 05:03:17,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d., pid=25, masterSystemTime=1675918997573 2023-02-09 05:03:17,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0474cd6ce4681a15c755d0effff737ab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67627883, jitterRate=0.007733985781669617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0474cd6ce4681a15c755d0effff737ab: Running coprocessor pre-open hook at 1675918997653Writing region info on filesystem at 1675918997653Initializing all the Stores at 1675918997655 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997655Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997655Cleaning up temporary data from old regions at 1675918997667 (+12 ms)Cleaning up detritus from prior splits at 1675918997668 (+1 ms)Running coprocessor post-open hooks at 1675918997674 (+6 ms)Region opened successfully at 1675918997674 2023-02-09 05:03:17,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:17,674 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=33a7cf02a27c06f47fa4bfe393f8b21d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:17,674 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997674"}]},"ts":"1675918997674"} 2023-02-09 05:03:17,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab., pid=28, masterSystemTime=1675918997581 2023-02-09 05:03:17,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:17,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 67e78fe7a85e34ecc9e1d7aed8e1dbd6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-09 05:03:17,676 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=0474cd6ce4681a15c755d0effff737ab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,676 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997676"}]},"ts":"1675918997676"} 2023-02-09 05:03:17,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:17,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,677 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-09 05:03:17,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 33a7cf02a27c06f47fa4bfe393f8b21d, server=jenkins-hbase4.apache.org,38433,1675918995805 in 248 msec 2023-02-09 05:03:17,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, ASSIGN in 418 msec 2023-02-09 05:03:17,678 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1 2023-02-09 05:03:17,679 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1 2023-02-09 05:03:17,679 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 columnFamilyName f1 2023-02-09 05:03:17,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-09 05:03:17,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 0474cd6ce4681a15c755d0effff737ab, server=jenkins-hbase4.apache.org,33859,1675918995834 in 247 msec 2023-02-09 05:03:17,679 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(310): Store=67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,679 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,680 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, ASSIGN in 420 msec 2023-02-09 05:03:17,681 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2 2023-02-09 05:03:17,681 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2 2023-02-09 05:03:17,681 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 columnFamilyName f2 2023-02-09 05:03:17,681 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(310): Store=67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:17,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:17,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:17,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:17,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 67e78fe7a85e34ecc9e1d7aed8e1dbd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63788496, jitterRate=-0.049477338790893555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:17,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Running coprocessor pre-open hook at 1675918997676Writing region info on filesystem at 1675918997676Initializing all the Stores at 1675918997677 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997677Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675918997677Cleaning up temporary data from old regions at 1675918997683 (+6 ms)Cleaning up detritus from prior splits at 1675918997683Running coprocessor post-open hooks at 1675918997686 (+3 ms)Region opened successfully at 1675918997686 2023-02-09 05:03:17,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6., pid=30, masterSystemTime=1675918997581 2023-02-09 05:03:17,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:17,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=67e78fe7a85e34ecc9e1d7aed8e1dbd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:17,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675918997688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675918997688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675918997688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675918997688"}]},"ts":"1675918997688"} 2023-02-09 05:03:17,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=19 2023-02-09 05:03:17,691 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:17,691 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:17,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=19, state=SUCCESS; OpenRegionProcedure 67e78fe7a85e34ecc9e1d7aed8e1dbd6, server=jenkins-hbase4.apache.org,33859,1675918995834 in 257 msec 2023-02-09 05:03:17,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:17,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-09 05:03:17,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, ASSIGN in 432 msec 2023-02-09 05:03:17,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:17,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675918997693"}]},"ts":"1675918997693"} 2023-02-09 05:03:17,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-09 05:03:17,696 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:17,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 617 msec 2023-02-09 05:03:18,192 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,192 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:18,194 INFO [Listener at localhost/37419] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-09 05:03:18,194 DEBUG [Listener at localhost/37419] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-09 05:03:18,194 INFO [Listener at localhost/37419] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:18,196 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-09 05:03:18,196 INFO [Listener at localhost/37419] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:18,196 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-09 05:03:18,197 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:18,231 DEBUG [hconnection-0x5666649a-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:18,242 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38433] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:18,243 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58478, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:18,248 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33859] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:18,306 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:18,306 INFO [Listener at localhost/37419] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:18,306 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,306 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 05:03:18,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675918998308 (current time:1675918998308). 2023-02-09 05:03:18,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:18,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] zookeeper.ReadOnlyZKClient(139): Connect 0x71606ac1 to 127.0.0.1:51781 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:18,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31c6d3f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:18,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:18,316 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34522, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:18,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71606ac1 to 127.0.0.1:51781 2023-02-09 05:03:18,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:18,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:18,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 05:03:18,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 05:03:18,321 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 05:03:18,321 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675919598321 2023-02-09 05:03:18,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-09 05:03:18,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,323 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:18,323 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:18,325 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-09 05:03:18,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 05:03:18,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-09 05:03:18,327 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 05:03:18,327 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675919598327 2023-02-09 05:03:18,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,340 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 05:03:18,340 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:18,341 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 05:03:18,341 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 05:03:18,341 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,341 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,344 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:18,344 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:18,344 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:18,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:18,344 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,344 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,345 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 05:03:18,345 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-09 05:03:18,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 05:03:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38433,1675918995805' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 05:03:18,352 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33859,1675918995834' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 05:03:18,353 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,353 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:18,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:18,354 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,354 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,354 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,354 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:18,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:18,354 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,354 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:18,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:18,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:18,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38433,1675918995805' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 05:03:18,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20470a4[Count = 1] remaining members to acquire global barrier 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:18,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33859,1675918995834' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 05:03:18,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20470a4[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:18,357 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 05:03:18,357 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,359 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,359 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:18,359 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:18,359 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,359 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. started... 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. started... 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. started... 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:18,359 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. started... 2023-02-09 05:03:18,360 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:03:18,360 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:18,360 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:03:18,361 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-09 05:03:18,361 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:18,360 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 432ad7357ee1ec322c688cf46abcb9cd 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,361 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:18,360 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 33a7cf02a27c06f47fa4bfe393f8b21d 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-09 05:03:18,361 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. started... 2023-02-09 05:03:18,361 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. started... 2023-02-09 05:03:18,361 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:18,362 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 122f54af406924ee1baa6592304c4679: 2023-02-09 05:03:18,361 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 02c9246320a746fdd379e09775311b81: 2023-02-09 05:03:18,362 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9ff8c4b092cda73a08d1b1c24c4e7f91 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,362 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,362 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,363 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,363 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,364 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:18,364 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:18,364 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:18,364 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-09 05:03:18,385 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. completed. 2023-02-09 05:03:18,386 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:18,386 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:18,386 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:03:18,386 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. started... 2023-02-09 05:03:18,388 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f1/74aa2d6e062744e696aed1a5cc37f579 2023-02-09 05:03:18,392 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. completed. 2023-02-09 05:03:18,389 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3bad2a73089572ab0abab2298d19d65f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,396 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:18,396 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:18,396 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. started... 2023-02-09 05:03:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-09 05:03:18,397 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegion(2744): Flushing bc4eb96e00c3268767f2496010e195ee 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,400 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f1/fb092b09217143509ca0a5d8665a2219 2023-02-09 05:03:18,404 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f1/161df44d1e5d4efcafe376ebe4073079 2023-02-09 05:03:18,412 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f1/3d5fe2b7765b40e584028387ff881479 2023-02-09 05:03:18,423 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:18,423 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,423 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 05:03:18,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:18,425 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:18,444 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f1/1435ecda645049f1b5bfa9c141416a35 2023-02-09 05:03:18,448 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f1/a58525e05c3c4b1ea0f8c48f591024da 2023-02-09 05:03:18,466 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f2/84f55f65dfc5467e8e9e5052c1c41bd8 2023-02-09 05:03:18,471 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f1/fb092b09217143509ca0a5d8665a2219 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219 2023-02-09 05:03:18,475 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,476 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f2/84f55f65dfc5467e8e9e5052c1c41bd8 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8 2023-02-09 05:03:18,480 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,481 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9ff8c4b092cda73a08d1b1c24c4e7f91 in 119ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,481 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219] hfiles 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8] hfiles 2023-02-09 05:03:18,482 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,483 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f2/12ee6cf213914d6bb6404513f366b3e2 2023-02-09 05:03:18,489 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f2/0ba1fa319eab4c5db22efcc4e54a875f 2023-02-09 05:03:18,494 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f1/161df44d1e5d4efcafe376ebe4073079 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079 2023-02-09 05:03:18,495 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f1/3d5fe2b7765b40e584028387ff881479 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479 2023-02-09 05:03:18,496 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f2/ca643a3f77614d5eb05aa47b407d310a 2023-02-09 05:03:18,499 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,500 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:18,500 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f2/12ee6cf213914d6bb6404513f366b3e2 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2 2023-02-09 05:03:18,501 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f2/0ba1fa319eab4c5db22efcc4e54a875f as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f 2023-02-09 05:03:18,502 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f1/a58525e05c3c4b1ea0f8c48f591024da as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da 2023-02-09 05:03:18,504 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f2/38af16bedb0244a7a405603f39a8cb6f 2023-02-09 05:03:18,505 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f2/9d892c26310c4513819e8bce4ed7c77a 2023-02-09 05:03:18,506 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:18,507 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 67e78fe7a85e34ecc9e1d7aed8e1dbd6 in 147ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,508 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: 2023-02-09 05:03:18,508 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,508 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,508 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479] hfiles 2023-02-09 05:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f] hfiles 2023-02-09 05:03:18,509 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,511 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f1/1435ecda645049f1b5bfa9c141416a35 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35 2023-02-09 05:03:18,513 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,513 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f2/ca643a3f77614d5eb05aa47b407d310a as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a 2023-02-09 05:03:18,514 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,515 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 432ad7357ee1ec322c688cf46abcb9cd in 155ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 432ad7357ee1ec322c688cf46abcb9cd: 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079] hfiles 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2] hfiles 2023-02-09 05:03:18,515 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,516 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. completed. 2023-02-09 05:03:18,516 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:18,516 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:18,516 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:03:18,516 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. started... 2023-02-09 05:03:18,517 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f1/74aa2d6e062744e696aed1a5cc37f579 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579 2023-02-09 05:03:18,517 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,518 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f2/38af16bedb0244a7a405603f39a8cb6f as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f 2023-02-09 05:03:18,520 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,521 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bc4eb96e00c3268767f2496010e195ee in 124ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,521 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for bc4eb96e00c3268767f2496010e195ee: 2023-02-09 05:03:18,522 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 93e6cca95845a69da56c80153f65963d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da] hfiles 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a] hfiles 2023-02-09 05:03:18,522 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,524 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:18,526 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f2/9d892c26310c4513819e8bce4ed7c77a as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a 2023-02-09 05:03:18,526 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. completed. 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:18,527 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3bad2a73089572ab0abab2298d19d65f in 138ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. started... 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3bad2a73089572ab0abab2298d19d65f: 2023-02-09 05:03:18,527 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-09 05:03:18,527 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,528 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,528 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35] hfiles 2023-02-09 05:03:18,528 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,528 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f] hfiles 2023-02-09 05:03:18,528 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,537 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-09 05:03:18,538 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 33a7cf02a27c06f47fa4bfe393f8b21d in 178ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 33a7cf02a27c06f47fa4bfe393f8b21d: 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579] hfiles 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a] hfiles 2023-02-09 05:03:18,538 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,540 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0474cd6ce4681a15c755d0effff737ab 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-09 05:03:18,541 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. completed. 2023-02-09 05:03:18,541 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:18,541 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:03:18,548 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. completed. 2023-02-09 05:03:18,548 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:18,548 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:03:18,568 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f1/e33a55f49dce407185b742d27c03a8b4 2023-02-09 05:03:18,572 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. completed. 2023-02-09 05:03:18,572 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:18,572 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-09 05:03:18,572 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. completed. 2023-02-09 05:03:18,573 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:18,573 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-09 05:03:18,577 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f1/06ad57774c154cb9bcbbdf5c33838e44 2023-02-09 05:03:18,584 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f2/cfa2efc1306c42218a4b441eedc035aa 2023-02-09 05:03:18,588 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f1/e33a55f49dce407185b742d27c03a8b4 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4 2023-02-09 05:03:18,592 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,593 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f2/cfa2efc1306c42218a4b441eedc035aa as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa 2023-02-09 05:03:18,598 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,598 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f2/953754a911ca42bb977ecb4525308f56 2023-02-09 05:03:18,599 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 93e6cca95845a69da56c80153f65963d in 77ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 93e6cca95845a69da56c80153f65963d: 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4] hfiles 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa] hfiles 2023-02-09 05:03:18,599 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,603 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f1/06ad57774c154cb9bcbbdf5c33838e44 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44 2023-02-09 05:03:18,605 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. completed. 2023-02-09 05:03:18,605 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:18,605 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:03:18,605 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:03:18,605 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,605 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 05:03:18,605 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38433,1675918995805' in zk 2023-02-09 05:03:18,607 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,607 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:03:18,607 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,607 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f2/953754a911ca42bb977ecb4525308f56 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56 2023-02-09 05:03:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:18,607 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:18,608 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 05:03:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:18,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:18,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38433,1675918995805': 2023-02-09 05:03:18,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38433,1675918995805' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 05:03:18,611 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-09 05:03:18,612 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0474cd6ce4681a15c755d0effff737ab in 72ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0474cd6ce4681a15c755d0effff737ab: 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44] hfiles 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56] hfiles 2023-02-09 05:03:18,612 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,617 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. completed. 2023-02-09 05:03:18,617 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-09 05:03:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-09 05:03:18,617 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 05:03:18,618 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33859,1675918995834' in zk 2023-02-09 05:03:18,619 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:03:18,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:18,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:18,619 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 05:03:18,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33859,1675918995834': 2023-02-09 05:03:18,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33859,1675918995834' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:18,622 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 05:03:18,622 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:18,622 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:18,622 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,622 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:18,623 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,623 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:18,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:18,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,623 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,623 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,624 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:18,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:18,624 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,624 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:18,625 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:18,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,625 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,625 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,626 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:18,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 05:03:18,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:18,626 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,627 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 05:03:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:18,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:18,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:18,632 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,632 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:18,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,632 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:18,633 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:18,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:18,633 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,633 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:18,633 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,633 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:18,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:18,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-09 05:03:18,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,687 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:18,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675918998322Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675918998633 (+311 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675918998633Writing data manifest for testWithMockedMapReduceMultiRegion at 1675918998648 (+15 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675918998658 (+10 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675918998686 (+28 ms) 2023-02-09 05:03:18,689 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-09 05:03:18,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 366 msec 2023-02-09 05:03:18,927 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:18,927 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,927 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-09 05:03:18,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:18,929 INFO [Listener at localhost/37419] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:18,929 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:18,929 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:18,933 INFO [Listener at localhost/37419] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:18,939 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:18,973 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38433] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:18,974 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33859] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,024 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:19,028 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:19,028 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:19,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,035 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-09 05:03:19,036 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:19,036 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-09 05:03:19,036 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-09 05:03:19,037 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,037 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,038 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:19,038 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:19,038 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:19,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:19,039 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,039 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,039 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,039 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,040 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 05:03:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:19,044 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-09 05:03:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:19,045 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:03:19,046 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. started... 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. started... 2023-02-09 05:03:19,046 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:03:19,046 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 432ad7357ee1ec322c688cf46abcb9cd 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. started... 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. started... 2023-02-09 05:03:19,046 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 33a7cf02a27c06f47fa4bfe393f8b21d 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-09 05:03:19,046 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 02c9246320a746fdd379e09775311b81: 2023-02-09 05:03:19,047 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,052 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:03:19,052 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:19,052 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,053 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. started... 2023-02-09 05:03:19,054 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 122f54af406924ee1baa6592304c4679: 2023-02-09 05:03:19,054 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,054 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. started... 2023-02-09 05:03:19,054 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9ff8c4b092cda73a08d1b1c24c4e7f91 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,054 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-09 05:03:19,055 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:19,055 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:03:19,054 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,054 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,056 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,056 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. started... 2023-02-09 05:03:19,056 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bc4eb96e00c3268767f2496010e195ee 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,056 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. started... 2023-02-09 05:03:19,056 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-09 05:03:19,057 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3bad2a73089572ab0abab2298d19d65f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,080 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f1/e000ee46e55b4b5fab8bc11c15af157f 2023-02-09 05:03:19,088 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f1/b3dce87109a74a1fba96a28251482c42 2023-02-09 05:03:19,100 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f1/05c90afad9a14c9584a7226a3c6b2774 2023-02-09 05:03:19,100 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f1/372d3796ddbb4b64b052fb290b897927 2023-02-09 05:03:19,116 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f1/0e75f177a6a341d8bde5b594db203093 2023-02-09 05:03:19,142 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f2/e09b76b8d96a40e9858a3d5714434239 2023-02-09 05:03:19,152 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f2/2cbf537329ac47b3a43219aa57a2f05e 2023-02-09 05:03:19,155 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f2/68a3fdbe080049a98cd0b1768efbcaeb 2023-02-09 05:03:19,156 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f2/3e912375f33540aa888cf328abe2e17a 2023-02-09 05:03:19,157 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f2/79966c1087144536813e7699a45dfaa8 2023-02-09 05:03:19,157 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f1/e000ee46e55b4b5fab8bc11c15af157f as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/e000ee46e55b4b5fab8bc11c15af157f 2023-02-09 05:03:19,158 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f1/372d3796ddbb4b64b052fb290b897927 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/372d3796ddbb4b64b052fb290b897927 2023-02-09 05:03:19,161 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f1/0e75f177a6a341d8bde5b594db203093 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/0e75f177a6a341d8bde5b594db203093 2023-02-09 05:03:19,164 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/372d3796ddbb4b64b052fb290b897927, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:19,165 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/.tmp/f2/2cbf537329ac47b3a43219aa57a2f05e as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/2cbf537329ac47b3a43219aa57a2f05e 2023-02-09 05:03:19,168 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/0e75f177a6a341d8bde5b594db203093, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,168 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f1/b3dce87109a74a1fba96a28251482c42 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/b3dce87109a74a1fba96a28251482c42 2023-02-09 05:03:19,169 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/e000ee46e55b4b5fab8bc11c15af157f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,169 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f1/05c90afad9a14c9584a7226a3c6b2774 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/05c90afad9a14c9584a7226a3c6b2774 2023-02-09 05:03:19,170 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/.tmp/f2/3e912375f33540aa888cf328abe2e17a as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/3e912375f33540aa888cf328abe2e17a 2023-02-09 05:03:19,170 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/.tmp/f2/e09b76b8d96a40e9858a3d5714434239 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/e09b76b8d96a40e9858a3d5714434239 2023-02-09 05:03:19,172 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/2cbf537329ac47b3a43219aa57a2f05e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:19,173 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 67e78fe7a85e34ecc9e1d7aed8e1dbd6 in 126ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,173 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: 2023-02-09 05:03:19,173 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,173 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,173 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:03:19,173 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. started... 2023-02-09 05:03:19,173 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0474cd6ce4681a15c755d0effff737ab 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,174 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/b3dce87109a74a1fba96a28251482c42, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,176 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/05c90afad9a14c9584a7226a3c6b2774, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:19,176 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/.tmp/f2/79966c1087144536813e7699a45dfaa8 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/79966c1087144536813e7699a45dfaa8 2023-02-09 05:03:19,178 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/3e912375f33540aa888cf328abe2e17a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,178 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/.tmp/f2/68a3fdbe080049a98cd0b1768efbcaeb as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/68a3fdbe080049a98cd0b1768efbcaeb 2023-02-09 05:03:19,178 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 432ad7357ee1ec322c688cf46abcb9cd in 132ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,178 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 432ad7357ee1ec322c688cf46abcb9cd: 2023-02-09 05:03:19,178 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,178 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:03:19,181 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/e09b76b8d96a40e9858a3d5714434239, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,182 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9ff8c4b092cda73a08d1b1c24c4e7f91 in 128ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,182 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: 2023-02-09 05:03:19,182 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,184 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,184 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-09 05:03:19,184 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. started... 2023-02-09 05:03:19,184 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 93e6cca95845a69da56c80153f65963d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-09 05:03:19,186 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/79966c1087144536813e7699a45dfaa8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,187 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/68a3fdbe080049a98cd0b1768efbcaeb, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-09 05:03:19,187 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3bad2a73089572ab0abab2298d19d65f in 130ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,187 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3bad2a73089572ab0abab2298d19d65f: 2023-02-09 05:03:19,187 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,187 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-09 05:03:19,187 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 33a7cf02a27c06f47fa4bfe393f8b21d in 141ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,188 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 33a7cf02a27c06f47fa4bfe393f8b21d: 2023-02-09 05:03:19,188 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,188 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:03:19,192 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f1/a4bbf88ec7704b12af6d54a223c01a5e 2023-02-09 05:03:19,204 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f1/a49239b6f4064abba43672216000599d 2023-02-09 05:03:19,219 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f2/0351f00ffe10430d9fbd85120eceffe8 2023-02-09 05:03:19,223 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f1/a4bbf88ec7704b12af6d54a223c01a5e as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/a4bbf88ec7704b12af6d54a223c01a5e 2023-02-09 05:03:19,225 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f2/2845f7e036474043abfa880384dafe8e 2023-02-09 05:03:19,227 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/a4bbf88ec7704b12af6d54a223c01a5e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,228 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/.tmp/f2/0351f00ffe10430d9fbd85120eceffe8 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/0351f00ffe10430d9fbd85120eceffe8 2023-02-09 05:03:19,229 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f1/a49239b6f4064abba43672216000599d as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/a49239b6f4064abba43672216000599d 2023-02-09 05:03:19,231 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/0351f00ffe10430d9fbd85120eceffe8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,232 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0474cd6ce4681a15c755d0effff737ab in 59ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,232 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0474cd6ce4681a15c755d0effff737ab: 2023-02-09 05:03:19,232 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,232 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-09 05:03:19,233 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/a49239b6f4064abba43672216000599d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,234 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/.tmp/f2/2845f7e036474043abfa880384dafe8e as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/2845f7e036474043abfa880384dafe8e 2023-02-09 05:03:19,237 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/2845f7e036474043abfa880384dafe8e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,238 INFO [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 93e6cca95845a69da56c80153f65963d in 54ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,238 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 93e6cca95845a69da56c80153f65963d: 2023-02-09 05:03:19,238 DEBUG [rs(jenkins-hbase4.apache.org,38433,1675918995805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:03:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:03:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 05:03:19,238 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38433,1675918995805' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 05:03:19,240 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,240 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:19,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:19,241 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:19,241 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:19,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:19,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38433,1675918995805' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 05:03:19,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63bf43c[Count = 1] remaining members to acquire global barrier 2023-02-09 05:03:19,540 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f1/1be7b79790fb413da345c289ea4ead5c 2023-02-09 05:03:19,554 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f2/72fbfa62bfbf4503ac19f35e2c96912a 2023-02-09 05:03:19,559 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f1/1be7b79790fb413da345c289ea4ead5c as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/1be7b79790fb413da345c289ea4ead5c 2023-02-09 05:03:19,562 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/1be7b79790fb413da345c289ea4ead5c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,563 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/.tmp/f2/72fbfa62bfbf4503ac19f35e2c96912a as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/72fbfa62bfbf4503ac19f35e2c96912a 2023-02-09 05:03:19,567 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/72fbfa62bfbf4503ac19f35e2c96912a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-09 05:03:19,567 INFO [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bc4eb96e00c3268767f2496010e195ee in 511ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:19,568 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bc4eb96e00c3268767f2496010e195ee: 2023-02-09 05:03:19,568 DEBUG [rs(jenkins-hbase4.apache.org,33859,1675918995834)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-09 05:03:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-09 05:03:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-09 05:03:19,568 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33859,1675918995834' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-09 05:03:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,569 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:19,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,569 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:19,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33859,1675918995834' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-09 05:03:19,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63bf43c[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:19,571 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-09 05:03:19,571 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,574 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,38433,1675918995805' in zk 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-09 05:03:19,574 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33859,1675918995834' in zk 2023-02-09 05:03:19,574 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,574 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:19,575 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,575 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:03:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:19,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:19,575 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:19,575 DEBUG [member: 'jenkins-hbase4.apache.org,38433,1675918995805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 05:03:19,576 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-09 05:03:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:19,576 DEBUG [member: 'jenkins-hbase4.apache.org,33859,1675918995834' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-09 05:03:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:19,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,38433,1675918995805': 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38433,1675918995805' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33859,1675918995834': 2023-02-09 05:03:19,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33859,1675918995834' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:19,580 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-09 05:03:19,581 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:19,581 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:19,581 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,581 INFO [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:19,582 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:19,582 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:19,583 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:19,583 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:19,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,584 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:19,585 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,588 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,588 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,588 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,588 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:19,588 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:19,589 DEBUG [(jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:19,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:19,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:19,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-09 05:03:19,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:19,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:19,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:19,589 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:19,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:19,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:19,690 DEBUG [Listener at localhost/37419] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:19,690 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:19,690 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:19,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:19,696 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675918998308 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:19,696 DEBUG [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,696 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(239): region to add: 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=33a7cf02a27c06f47fa4bfe393f8b21d as 33a7cf02a27c06f47fa4bfe393f8b21d in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=02c9246320a746fdd379e09775311b81 as 02c9246320a746fdd379e09775311b81 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=67e78fe7a85e34ecc9e1d7aed8e1dbd6 as 67e78fe7a85e34ecc9e1d7aed8e1dbd6 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=9ff8c4b092cda73a08d1b1c24c4e7f91 as 9ff8c4b092cda73a08d1b1c24c4e7f91 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=432ad7357ee1ec322c688cf46abcb9cd as 432ad7357ee1ec322c688cf46abcb9cd in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=122f54af406924ee1baa6592304c4679 as 122f54af406924ee1baa6592304c4679 in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=bc4eb96e00c3268767f2496010e195ee as bc4eb96e00c3268767f2496010e195ee in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=3bad2a73089572ab0abab2298d19d65f as 3bad2a73089572ab0abab2298d19d65f in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=0474cd6ce4681a15c755d0effff737ab as 0474cd6ce4681a15c755d0effff737ab in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,697 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(585): clone region=93e6cca95845a69da56c80153f65963d as 93e6cca95845a69da56c80153f65963d in snapshot testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,699 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 3bad2a73089572ab0abab2298d19d65f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,699 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 02c9246320a746fdd379e09775311b81, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,699 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 33a7cf02a27c06f47fa4bfe393f8b21d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,699 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 122f54af406924ee1baa6592304c4679, NAME => 'testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,700 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 67e78fe7a85e34ecc9e1d7aed8e1dbd6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,700 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9ff8c4b092cda73a08d1b1c24c4e7f91, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,700 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 432ad7357ee1ec322c688cf46abcb9cd, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,700 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => bc4eb96e00c3268767f2496010e195ee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,724 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,724 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb092b09217143509ca0a5d8665a2219 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,738 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 84f55f65dfc5467e8e9e5052c1c41bd8 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,749 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9ff8c4b092cda73a08d1b1c24c4e7f91, disabling compactions & flushes 2023-02-09 05:03:19,749 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,749 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,749 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. after waiting 0 ms 2023-02-09 05:03:19,749 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,749 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:19,749 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Waiting for close lock at 1675918999749Disabling compacts and flushes for region at 1675918999749Disabling writes for close at 1675918999749Writing region close event to WAL at 1675918999749Closed at 1675918999749 2023-02-09 05:03:19,750 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 0474cd6ce4681a15c755d0effff737ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,751 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,751 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 122f54af406924ee1baa6592304c4679, disabling compactions & flushes 2023-02-09 05:03:19,751 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,751 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,752 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. after waiting 0 ms 2023-02-09 05:03:19,752 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,752 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:19,752 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 122f54af406924ee1baa6592304c4679: Waiting for close lock at 1675918999751Disabling compacts and flushes for region at 1675918999751Disabling writes for close at 1675918999752 (+1 ms)Writing region close event to WAL at 1675918999752Closed at 1675918999752 2023-02-09 05:03:19,752 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 93e6cca95845a69da56c80153f65963d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,760 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,760 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,761 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74aa2d6e062744e696aed1a5cc37f579 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,760 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3d5fe2b7765b40e584028387ff881479 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,763 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,763 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 161df44d1e5d4efcafe376ebe4073079 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,766 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,766 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a58525e05c3c4b1ea0f8c48f591024da from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,766 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,767 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1435ecda645049f1b5bfa9c141416a35 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 02c9246320a746fdd379e09775311b81, disabling compactions & flushes 2023-02-09 05:03:19,772 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. after waiting 0 ms 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,772 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:19,772 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 02c9246320a746fdd379e09775311b81: Waiting for close lock at 1675918999772Disabling compacts and flushes for region at 1675918999772Disabling writes for close at 1675918999772Writing region close event to WAL at 1675918999772Closed at 1675918999772 2023-02-09 05:03:19,776 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 12ee6cf213914d6bb6404513f366b3e2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,784 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,784 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e33a55f49dce407185b742d27c03a8b4 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,785 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ca643a3f77614d5eb05aa47b407d310a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,785 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 432ad7357ee1ec322c688cf46abcb9cd, disabling compactions & flushes 2023-02-09 05:03:19,785 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ba1fa319eab4c5db22efcc4e54a875f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,785 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9d892c26310c4513819e8bce4ed7c77a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,785 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,786 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,786 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. after waiting 0 ms 2023-02-09 05:03:19,786 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,786 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:19,786 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 432ad7357ee1ec322c688cf46abcb9cd: Waiting for close lock at 1675918999785Disabling compacts and flushes for region at 1675918999785Disabling writes for close at 1675918999786 (+1 ms)Writing region close event to WAL at 1675918999786Closed at 1675918999786 2023-02-09 05:03:19,786 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 38af16bedb0244a7a405603f39a8cb6f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,792 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:19,792 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cfa2efc1306c42218a4b441eedc035aa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,792 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 06ad57774c154cb9bcbbdf5c33838e44 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,792 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 67e78fe7a85e34ecc9e1d7aed8e1dbd6, disabling compactions & flushes 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing bc4eb96e00c3268767f2496010e195ee, disabling compactions & flushes 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. after waiting 0 ms 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. after waiting 0 ms 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 3bad2a73089572ab0abab2298d19d65f, disabling compactions & flushes 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 33a7cf02a27c06f47fa4bfe393f8b21d, disabling compactions & flushes 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for bc4eb96e00c3268767f2496010e195ee: Waiting for close lock at 1675918999793Disabling compacts and flushes for region at 1675918999793Disabling writes for close at 1675918999793Writing region close event to WAL at 1675918999793Closed at 1675918999793 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Waiting for close lock at 1675918999792Disabling compacts and flushes for region at 1675918999792Disabling writes for close at 1675918999793 (+1 ms)Writing region close event to WAL at 1675918999793Closed at 1675918999793 2023-02-09 05:03:19,793 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,793 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. after waiting 0 ms 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,794 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 3bad2a73089572ab0abab2298d19d65f: Waiting for close lock at 1675918999793Disabling compacts and flushes for region at 1675918999793Disabling writes for close at 1675918999794 (+1 ms)Writing region close event to WAL at 1675918999794Closed at 1675918999794 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. after waiting 0 ms 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,794 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:19,794 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Waiting for close lock at 1675918999793Disabling compacts and flushes for region at 1675918999793Disabling writes for close at 1675918999794 (+1 ms)Writing region close event to WAL at 1675918999794Closed at 1675918999794 2023-02-09 05:03:19,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 93e6cca95845a69da56c80153f65963d, disabling compactions & flushes 2023-02-09 05:03:19,800 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. after waiting 0 ms 2023-02-09 05:03:19,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,800 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:19,800 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 93e6cca95845a69da56c80153f65963d: Waiting for close lock at 1675918999800Disabling compacts and flushes for region at 1675918999800Disabling writes for close at 1675918999800Writing region close event to WAL at 1675918999800Closed at 1675918999800 2023-02-09 05:03:19,800 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 953754a911ca42bb977ecb4525308f56 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:19,802 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 0474cd6ce4681a15c755d0effff737ab, disabling compactions & flushes 2023-02-09 05:03:19,802 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,802 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,802 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. after waiting 0 ms 2023-02-09 05:03:19,802 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,802 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:19,803 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 0474cd6ce4681a15c755d0effff737ab: Waiting for close lock at 1675918999802Disabling compacts and flushes for region at 1675918999802Disabling writes for close at 1675918999802Writing region close event to WAL at 1675918999802Closed at 1675918999802 2023-02-09 05:03:19,803 INFO [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675918998308 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:19,803 DEBUG [Listener at localhost/37419] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,803 DEBUG [Listener at localhost/37419] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d 2023-02-09 05:03:19,804 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:19,804 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:19,804 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-09 05:03:19,805 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------02c9246320a746fdd379e09775311b81/ 2023-02-09 05:03:19,805 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,805 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------0474cd6ce4681a15c755d0effff737ab/ 2023-02-09 05:03:19,805 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,805 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,806 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0474cd6ce4681a15c755d0effff737ab-06ad57774c154cb9bcbbdf5c33838e44 2023-02-09 05:03:19,806 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,806 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=0474cd6ce4681a15c755d0effff737ab-953754a911ca42bb977ecb4525308f56 2023-02-09 05:03:19,806 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------122f54af406924ee1baa6592304c4679/ 2023-02-09 05:03:19,806 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,807 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------33a7cf02a27c06f47fa4bfe393f8b21d/ 2023-02-09 05:03:19,807 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,807 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,807 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33a7cf02a27c06f47fa4bfe393f8b21d-74aa2d6e062744e696aed1a5cc37f579 2023-02-09 05:03:19,807 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33a7cf02a27c06f47fa4bfe393f8b21d-9d892c26310c4513819e8bce4ed7c77a 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------3bad2a73089572ab0abab2298d19d65f/ 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3bad2a73089572ab0abab2298d19d65f-1435ecda645049f1b5bfa9c141416a35 2023-02-09 05:03:19,808 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3bad2a73089572ab0abab2298d19d65f-38af16bedb0244a7a405603f39a8cb6f 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------432ad7357ee1ec322c688cf46abcb9cd/ 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=432ad7357ee1ec322c688cf46abcb9cd-161df44d1e5d4efcafe376ebe4073079 2023-02-09 05:03:19,809 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=432ad7357ee1ec322c688cf46abcb9cd-12ee6cf213914d6bb6404513f366b3e2 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------67e78fe7a85e34ecc9e1d7aed8e1dbd6/ 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=67e78fe7a85e34ecc9e1d7aed8e1dbd6-3d5fe2b7765b40e584028387ff881479 2023-02-09 05:03:19,810 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=67e78fe7a85e34ecc9e1d7aed8e1dbd6-0ba1fa319eab4c5db22efcc4e54a875f 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------93e6cca95845a69da56c80153f65963d/ 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=93e6cca95845a69da56c80153f65963d-e33a55f49dce407185b742d27c03a8b4 2023-02-09 05:03:19,811 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,812 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=93e6cca95845a69da56c80153f65963d-cfa2efc1306c42218a4b441eedc035aa 2023-02-09 05:03:19,812 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------9ff8c4b092cda73a08d1b1c24c4e7f91/ 2023-02-09 05:03:19,812 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,812 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,812 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9ff8c4b092cda73a08d1b1c24c4e7f91-fb092b09217143509ca0a5d8665a2219 2023-02-09 05:03:19,813 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,813 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=9ff8c4b092cda73a08d1b1c24c4e7f91-84f55f65dfc5467e8e9e5052c1c41bd8 2023-02-09 05:03:19,813 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |----------bc4eb96e00c3268767f2496010e195ee/ 2023-02-09 05:03:19,813 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:19,813 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:19,814 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc4eb96e00c3268767f2496010e195ee-a58525e05c3c4b1ea0f8c48f591024da 2023-02-09 05:03:19,814 DEBUG [Listener at localhost/37419] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:19,814 DEBUG [Listener at localhost/37419] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc4eb96e00c3268767f2496010e195ee-ca643a3f77614d5eb05aa47b407d310a 2023-02-09 05:03:19,817 INFO [Listener at localhost/37419] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 05:03:20,493 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,493 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,495 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,497 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:20,498 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f1 2023-02-09 05:03:20,499 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02c9246320a746fdd379e09775311b81 columnFamilyName f1 2023-02-09 05:03:20,499 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(310): Store=02c9246320a746fdd379e09775311b81/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,499 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:20,500 DEBUG [StoreOpener-02c9246320a746fdd379e09775311b81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f2 2023-02-09 05:03:20,501 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02c9246320a746fdd379e09775311b81 columnFamilyName f2 2023-02-09 05:03:20,501 INFO [StoreOpener-02c9246320a746fdd379e09775311b81-1] regionserver.HStore(310): Store=02c9246320a746fdd379e09775311b81/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,501 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,501 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 02c9246320a746fdd379e09775311b81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61332153, jitterRate=-0.08607970178127289}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,501 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 02c9246320a746fdd379e09775311b81: Writing region info on filesystem at 1675919000495Initializing all the Stores at 1675919000496 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000496Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000496Region opened successfully at 1675919000501 (+5 ms) 2023-02-09 05:03:20,502 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 02c9246320a746fdd379e09775311b81, disabling compactions & flushes 2023-02-09 05:03:20,502 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,502 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,502 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. after waiting 0 ms 2023-02-09 05:03:20,502 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,502 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,502 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 02c9246320a746fdd379e09775311b81: Waiting for close lock at 1675919000502Disabling compacts and flushes for region at 1675919000502Disabling writes for close at 1675919000502Writing region close event to WAL at 1675919000502Closed at 1675919000502 2023-02-09 05:03:20,503 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,503 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,504 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,506 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:20,506 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1 2023-02-09 05:03:20,507 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0474cd6ce4681a15c755d0effff737ab columnFamilyName f1 2023-02-09 05:03:20,511 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/testWithMockedMapReduceMultiRegion=0474cd6ce4681a15c755d0effff737ab-06ad57774c154cb9bcbbdf5c33838e44 2023-02-09 05:03:20,511 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(310): Store=0474cd6ce4681a15c755d0effff737ab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,511 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:20,511 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2 2023-02-09 05:03:20,512 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0474cd6ce4681a15c755d0effff737ab columnFamilyName f2 2023-02-09 05:03:20,515 DEBUG [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/testWithMockedMapReduceMultiRegion=0474cd6ce4681a15c755d0effff737ab-953754a911ca42bb977ecb4525308f56 2023-02-09 05:03:20,515 INFO [StoreOpener-0474cd6ce4681a15c755d0effff737ab-1] regionserver.HStore(310): Store=0474cd6ce4681a15c755d0effff737ab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,515 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,515 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 0474cd6ce4681a15c755d0effff737ab; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70231837, jitterRate=0.046535924077034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,515 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 0474cd6ce4681a15c755d0effff737ab: Writing region info on filesystem at 1675919000504Initializing all the Stores at 1675919000505 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000505Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000505Region opened successfully at 1675919000515 (+10 ms) 2023-02-09 05:03:20,524 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 0474cd6ce4681a15c755d0effff737ab, disabling compactions & flushes 2023-02-09 05:03:20,524 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,524 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,524 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. after waiting 0 ms 2023-02-09 05:03:20,524 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,525 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,525 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 0474cd6ce4681a15c755d0effff737ab: Waiting for close lock at 1675919000524Disabling compacts and flushes for region at 1675919000524Disabling writes for close at 1675919000524Writing region close event to WAL at 1675919000525 (+1 ms)Closed at 1675919000525 2023-02-09 05:03:20,526 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,526 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,527 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,533 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:20,534 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f1 2023-02-09 05:03:20,534 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 122f54af406924ee1baa6592304c4679 columnFamilyName f1 2023-02-09 05:03:20,535 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(310): Store=122f54af406924ee1baa6592304c4679/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,535 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:20,536 DEBUG [StoreOpener-122f54af406924ee1baa6592304c4679-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f2 2023-02-09 05:03:20,536 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 122f54af406924ee1baa6592304c4679 columnFamilyName f2 2023-02-09 05:03:20,536 INFO [StoreOpener-122f54af406924ee1baa6592304c4679-1] regionserver.HStore(310): Store=122f54af406924ee1baa6592304c4679/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,536 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,536 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 122f54af406924ee1baa6592304c4679; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70189193, jitterRate=0.04590047895908356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,537 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 122f54af406924ee1baa6592304c4679: Writing region info on filesystem at 1675919000527Initializing all the Stores at 1675919000528 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000528Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000532 (+4 ms)Region opened successfully at 1675919000537 (+5 ms) 2023-02-09 05:03:20,537 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 122f54af406924ee1baa6592304c4679, disabling compactions & flushes 2023-02-09 05:03:20,537 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,537 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,537 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. after waiting 0 ms 2023-02-09 05:03:20,537 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,540 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,540 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 122f54af406924ee1baa6592304c4679: Waiting for close lock at 1675919000537Disabling compacts and flushes for region at 1675919000537Disabling writes for close at 1675919000537Writing region close event to WAL at 1675919000540 (+3 ms)Closed at 1675919000540 2023-02-09 05:03:20,540 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,540 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,543 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,544 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:20,545 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1 2023-02-09 05:03:20,546 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33a7cf02a27c06f47fa4bfe393f8b21d columnFamilyName f1 2023-02-09 05:03:20,553 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/testWithMockedMapReduceMultiRegion=33a7cf02a27c06f47fa4bfe393f8b21d-74aa2d6e062744e696aed1a5cc37f579 2023-02-09 05:03:20,553 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(310): Store=33a7cf02a27c06f47fa4bfe393f8b21d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,554 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:20,554 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2 2023-02-09 05:03:20,555 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33a7cf02a27c06f47fa4bfe393f8b21d columnFamilyName f2 2023-02-09 05:03:20,563 DEBUG [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/testWithMockedMapReduceMultiRegion=33a7cf02a27c06f47fa4bfe393f8b21d-9d892c26310c4513819e8bce4ed7c77a 2023-02-09 05:03:20,563 INFO [StoreOpener-33a7cf02a27c06f47fa4bfe393f8b21d-1] regionserver.HStore(310): Store=33a7cf02a27c06f47fa4bfe393f8b21d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,564 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,564 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 33a7cf02a27c06f47fa4bfe393f8b21d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64928190, jitterRate=-0.032494574785232544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,564 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Writing region info on filesystem at 1675919000543Initializing all the Stores at 1675919000543Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000543Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000544 (+1 ms)Region opened successfully at 1675919000564 (+20 ms) 2023-02-09 05:03:20,574 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 33a7cf02a27c06f47fa4bfe393f8b21d, disabling compactions & flushes 2023-02-09 05:03:20,574 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,574 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,574 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. after waiting 0 ms 2023-02-09 05:03:20,574 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,574 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,575 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Waiting for close lock at 1675919000574Disabling compacts and flushes for region at 1675919000574Disabling writes for close at 1675919000574Writing region close event to WAL at 1675919000574Closed at 1675919000574 2023-02-09 05:03:20,575 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,575 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,577 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,581 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:20,581 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1 2023-02-09 05:03:20,582 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bad2a73089572ab0abab2298d19d65f columnFamilyName f1 2023-02-09 05:03:20,585 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/testWithMockedMapReduceMultiRegion=3bad2a73089572ab0abab2298d19d65f-1435ecda645049f1b5bfa9c141416a35 2023-02-09 05:03:20,585 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(310): Store=3bad2a73089572ab0abab2298d19d65f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,585 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:20,586 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2 2023-02-09 05:03:20,587 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3bad2a73089572ab0abab2298d19d65f columnFamilyName f2 2023-02-09 05:03:20,591 DEBUG [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/testWithMockedMapReduceMultiRegion=3bad2a73089572ab0abab2298d19d65f-38af16bedb0244a7a405603f39a8cb6f 2023-02-09 05:03:20,591 INFO [StoreOpener-3bad2a73089572ab0abab2298d19d65f-1] regionserver.HStore(310): Store=3bad2a73089572ab0abab2298d19d65f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,591 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,592 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 3bad2a73089572ab0abab2298d19d65f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63224111, jitterRate=-0.057887330651283264}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,592 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 3bad2a73089572ab0abab2298d19d65f: Writing region info on filesystem at 1675919000577Initializing all the Stores at 1675919000577Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000577Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000580 (+3 ms)Region opened successfully at 1675919000592 (+12 ms) 2023-02-09 05:03:20,604 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 3bad2a73089572ab0abab2298d19d65f, disabling compactions & flushes 2023-02-09 05:03:20,605 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,605 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,605 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. after waiting 0 ms 2023-02-09 05:03:20,605 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,606 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,606 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 3bad2a73089572ab0abab2298d19d65f: Waiting for close lock at 1675919000604Disabling compacts and flushes for region at 1675919000604Disabling writes for close at 1675919000605 (+1 ms)Writing region close event to WAL at 1675919000606 (+1 ms)Closed at 1675919000606 2023-02-09 05:03:20,607 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,607 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,608 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,610 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:20,610 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1 2023-02-09 05:03:20,611 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6cca95845a69da56c80153f65963d columnFamilyName f1 2023-02-09 05:03:20,615 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/testWithMockedMapReduceMultiRegion=93e6cca95845a69da56c80153f65963d-e33a55f49dce407185b742d27c03a8b4 2023-02-09 05:03:20,615 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(310): Store=93e6cca95845a69da56c80153f65963d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,615 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:20,616 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2 2023-02-09 05:03:20,616 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93e6cca95845a69da56c80153f65963d columnFamilyName f2 2023-02-09 05:03:20,621 DEBUG [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/testWithMockedMapReduceMultiRegion=93e6cca95845a69da56c80153f65963d-cfa2efc1306c42218a4b441eedc035aa 2023-02-09 05:03:20,621 INFO [StoreOpener-93e6cca95845a69da56c80153f65963d-1] regionserver.HStore(310): Store=93e6cca95845a69da56c80153f65963d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,622 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,622 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 93e6cca95845a69da56c80153f65963d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70468129, jitterRate=0.05005694925785065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,622 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 93e6cca95845a69da56c80153f65963d: Writing region info on filesystem at 1675919000608Initializing all the Stores at 1675919000609 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000609Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000609Region opened successfully at 1675919000622 (+13 ms) 2023-02-09 05:03:20,630 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 93e6cca95845a69da56c80153f65963d, disabling compactions & flushes 2023-02-09 05:03:20,630 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,630 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,630 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. after waiting 0 ms 2023-02-09 05:03:20,630 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,631 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,631 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 93e6cca95845a69da56c80153f65963d: Waiting for close lock at 1675919000630Disabling compacts and flushes for region at 1675919000630Disabling writes for close at 1675919000630Writing region close event to WAL at 1675919000631 (+1 ms)Closed at 1675919000631 2023-02-09 05:03:20,632 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,632 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,633 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,635 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:20,636 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1 2023-02-09 05:03:20,636 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 432ad7357ee1ec322c688cf46abcb9cd columnFamilyName f1 2023-02-09 05:03:20,643 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/testWithMockedMapReduceMultiRegion=432ad7357ee1ec322c688cf46abcb9cd-161df44d1e5d4efcafe376ebe4073079 2023-02-09 05:03:20,643 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(310): Store=432ad7357ee1ec322c688cf46abcb9cd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,643 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:20,644 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2 2023-02-09 05:03:20,644 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 432ad7357ee1ec322c688cf46abcb9cd columnFamilyName f2 2023-02-09 05:03:20,652 DEBUG [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/testWithMockedMapReduceMultiRegion=432ad7357ee1ec322c688cf46abcb9cd-12ee6cf213914d6bb6404513f366b3e2 2023-02-09 05:03:20,652 INFO [StoreOpener-432ad7357ee1ec322c688cf46abcb9cd-1] regionserver.HStore(310): Store=432ad7357ee1ec322c688cf46abcb9cd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,652 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,652 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 432ad7357ee1ec322c688cf46abcb9cd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69466913, jitterRate=0.03513766825199127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,652 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 432ad7357ee1ec322c688cf46abcb9cd: Writing region info on filesystem at 1675919000633Initializing all the Stores at 1675919000634 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000634Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000634Region opened successfully at 1675919000652 (+18 ms) 2023-02-09 05:03:20,661 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 432ad7357ee1ec322c688cf46abcb9cd, disabling compactions & flushes 2023-02-09 05:03:20,661 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,661 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,661 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. after waiting 0 ms 2023-02-09 05:03:20,661 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,662 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,662 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 432ad7357ee1ec322c688cf46abcb9cd: Waiting for close lock at 1675919000661Disabling compacts and flushes for region at 1675919000661Disabling writes for close at 1675919000661Writing region close event to WAL at 1675919000662 (+1 ms)Closed at 1675919000662 2023-02-09 05:03:20,663 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,663 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,664 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,666 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:20,667 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1 2023-02-09 05:03:20,668 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc4eb96e00c3268767f2496010e195ee columnFamilyName f1 2023-02-09 05:03:20,672 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/testWithMockedMapReduceMultiRegion=bc4eb96e00c3268767f2496010e195ee-a58525e05c3c4b1ea0f8c48f591024da 2023-02-09 05:03:20,672 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(310): Store=bc4eb96e00c3268767f2496010e195ee/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,672 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:20,673 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2 2023-02-09 05:03:20,673 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc4eb96e00c3268767f2496010e195ee columnFamilyName f2 2023-02-09 05:03:20,679 DEBUG [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/testWithMockedMapReduceMultiRegion=bc4eb96e00c3268767f2496010e195ee-ca643a3f77614d5eb05aa47b407d310a 2023-02-09 05:03:20,679 INFO [StoreOpener-bc4eb96e00c3268767f2496010e195ee-1] regionserver.HStore(310): Store=bc4eb96e00c3268767f2496010e195ee/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,679 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,679 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened bc4eb96e00c3268767f2496010e195ee; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69061122, jitterRate=0.029090911149978638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,679 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for bc4eb96e00c3268767f2496010e195ee: Writing region info on filesystem at 1675919000665Initializing all the Stores at 1675919000665Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000665Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000665Region opened successfully at 1675919000679 (+14 ms) 2023-02-09 05:03:20,687 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing bc4eb96e00c3268767f2496010e195ee, disabling compactions & flushes 2023-02-09 05:03:20,687 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,688 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,688 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. after waiting 0 ms 2023-02-09 05:03:20,688 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,690 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,690 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for bc4eb96e00c3268767f2496010e195ee: Waiting for close lock at 1675919000687Disabling compacts and flushes for region at 1675919000687Disabling writes for close at 1675919000688 (+1 ms)Writing region close event to WAL at 1675919000690 (+2 ms)Closed at 1675919000690 2023-02-09 05:03:20,690 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,691 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,692 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,694 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:20,694 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1 2023-02-09 05:03:20,695 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff8c4b092cda73a08d1b1c24c4e7f91 columnFamilyName f1 2023-02-09 05:03:20,701 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/testWithMockedMapReduceMultiRegion=9ff8c4b092cda73a08d1b1c24c4e7f91-fb092b09217143509ca0a5d8665a2219 2023-02-09 05:03:20,701 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(310): Store=9ff8c4b092cda73a08d1b1c24c4e7f91/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,701 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:20,702 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2 2023-02-09 05:03:20,702 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ff8c4b092cda73a08d1b1c24c4e7f91 columnFamilyName f2 2023-02-09 05:03:20,705 DEBUG [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/testWithMockedMapReduceMultiRegion=9ff8c4b092cda73a08d1b1c24c4e7f91-84f55f65dfc5467e8e9e5052c1c41bd8 2023-02-09 05:03:20,706 INFO [StoreOpener-9ff8c4b092cda73a08d1b1c24c4e7f91-1] regionserver.HStore(310): Store=9ff8c4b092cda73a08d1b1c24c4e7f91/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,706 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,706 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 9ff8c4b092cda73a08d1b1c24c4e7f91; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65691692, jitterRate=-0.02111750841140747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,706 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Writing region info on filesystem at 1675919000692Initializing all the Stores at 1675919000693 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000693Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000693Region opened successfully at 1675919000706 (+13 ms) 2023-02-09 05:03:20,714 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 9ff8c4b092cda73a08d1b1c24c4e7f91, disabling compactions & flushes 2023-02-09 05:03:20,714 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,714 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,714 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. after waiting 0 ms 2023-02-09 05:03:20,714 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,715 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,715 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Waiting for close lock at 1675919000714Disabling compacts and flushes for region at 1675919000714Disabling writes for close at 1675919000714Writing region close event to WAL at 1675919000715 (+1 ms)Closed at 1675919000715 2023-02-09 05:03:20,716 DEBUG [Listener at localhost/37419] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:20,716 INFO [Listener at localhost/37419] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:20,717 DEBUG [Listener at localhost/37419] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:20,719 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:20,720 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1 2023-02-09 05:03:20,720 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 columnFamilyName f1 2023-02-09 05:03:20,723 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/testWithMockedMapReduceMultiRegion=67e78fe7a85e34ecc9e1d7aed8e1dbd6-3d5fe2b7765b40e584028387ff881479 2023-02-09 05:03:20,723 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(310): Store=67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,724 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:20,724 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2 2023-02-09 05:03:20,724 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67e78fe7a85e34ecc9e1d7aed8e1dbd6 columnFamilyName f2 2023-02-09 05:03:20,728 DEBUG [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(539): loaded hdfs://localhost:38581/user/jenkins/test-data/85df27fc-d060-2960-5087-c44d9a72bc2d/testWithMockedMapReduceMultiRegion/162fdbce-2262-407d-923a-79e790baa25d/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/testWithMockedMapReduceMultiRegion=67e78fe7a85e34ecc9e1d7aed8e1dbd6-0ba1fa319eab4c5db22efcc4e54a875f 2023-02-09 05:03:20,728 INFO [StoreOpener-67e78fe7a85e34ecc9e1d7aed8e1dbd6-1] regionserver.HStore(310): Store=67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:20,728 DEBUG [Listener at localhost/37419] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:20,728 INFO [Listener at localhost/37419] regionserver.HRegion(1071): Opened 67e78fe7a85e34ecc9e1d7aed8e1dbd6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58778448, jitterRate=-0.12413287162780762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:20,728 DEBUG [Listener at localhost/37419] regionserver.HRegion(964): Region open journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Writing region info on filesystem at 1675919000717Initializing all the Stores at 1675919000718 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000718Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919000718Region opened successfully at 1675919000728 (+10 ms) 2023-02-09 05:03:20,738 DEBUG [Listener at localhost/37419] regionserver.HRegion(1603): Closing 67e78fe7a85e34ecc9e1d7aed8e1dbd6, disabling compactions & flushes 2023-02-09 05:03:20,738 INFO [Listener at localhost/37419] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,738 DEBUG [Listener at localhost/37419] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,738 DEBUG [Listener at localhost/37419] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. after waiting 0 ms 2023-02-09 05:03:20,738 DEBUG [Listener at localhost/37419] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,739 INFO [Listener at localhost/37419] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,739 DEBUG [Listener at localhost/37419] regionserver.HRegion(1557): Region close journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Waiting for close lock at 1675919000738Disabling compacts and flushes for region at 1675919000738Disabling writes for close at 1675919000738Writing region close event to WAL at 1675919000739 (+1 ms)Closed at 1675919000739 2023-02-09 05:03:20,742 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:20,742 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:20,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-09 05:03:20,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-09 05:03:20,746 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:20,746 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:20,747 INFO [Listener at localhost/37419] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-09 05:03:20,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-09 05:03:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:20,750 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:20,750 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:20,751 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919000751"}]},"ts":"1675919000751"} 2023-02-09 05:03:20,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:03:20,752 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-09 05:03:20,754 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-09 05:03:20,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, UNASSIGN}] 2023-02-09 05:03:20,756 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, UNASSIGN 2023-02-09 05:03:20,756 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, UNASSIGN 2023-02-09 05:03:20,756 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, UNASSIGN 2023-02-09 05:03:20,756 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, UNASSIGN 2023-02-09 05:03:20,756 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, UNASSIGN 2023-02-09 05:03:20,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9ff8c4b092cda73a08d1b1c24c4e7f91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:20,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000757"}]},"ts":"1675919000757"} 2023-02-09 05:03:20,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3bad2a73089572ab0abab2298d19d65f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:20,757 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=432ad7357ee1ec322c688cf46abcb9cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:20,757 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000757"}]},"ts":"1675919000757"} 2023-02-09 05:03:20,757 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000757"}]},"ts":"1675919000757"} 2023-02-09 05:03:20,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bc4eb96e00c3268767f2496010e195ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:20,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02c9246320a746fdd379e09775311b81, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:20,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000757"}]},"ts":"1675919000757"} 2023-02-09 05:03:20,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675919000758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000758"}]},"ts":"1675919000758"} 2023-02-09 05:03:20,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=38, state=RUNNABLE; CloseRegionProcedure 9ff8c4b092cda73a08d1b1c24c4e7f91, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:20,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure 3bad2a73089572ab0abab2298d19d65f, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:20,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 432ad7357ee1ec322c688cf46abcb9cd, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:20,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=43, state=RUNNABLE; CloseRegionProcedure 02c9246320a746fdd379e09775311b81, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:20,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure bc4eb96e00c3268767f2496010e195ee, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:20,762 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, UNASSIGN 2023-02-09 05:03:20,762 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=67e78fe7a85e34ecc9e1d7aed8e1dbd6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:20,762 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, UNASSIGN 2023-02-09 05:03:20,762 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000762"}]},"ts":"1675919000762"} 2023-02-09 05:03:20,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=93e6cca95845a69da56c80153f65963d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:20,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000763"}]},"ts":"1675919000763"} 2023-02-09 05:03:20,764 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, UNASSIGN 2023-02-09 05:03:20,764 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, UNASSIGN 2023-02-09 05:03:20,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 67e78fe7a85e34ecc9e1d7aed8e1dbd6, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:20,764 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, UNASSIGN 2023-02-09 05:03:20,765 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0474cd6ce4681a15c755d0effff737ab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:20,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 93e6cca95845a69da56c80153f65963d, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:20,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000765"}]},"ts":"1675919000765"} 2023-02-09 05:03:20,765 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=33a7cf02a27c06f47fa4bfe393f8b21d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:20,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000765"}]},"ts":"1675919000765"} 2023-02-09 05:03:20,765 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=122f54af406924ee1baa6592304c4679, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:20,765 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675919000765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919000765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919000765"}]},"ts":"1675919000765"} 2023-02-09 05:03:20,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 0474cd6ce4681a15c755d0effff737ab, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:20,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure 33a7cf02a27c06f47fa4bfe393f8b21d, server=jenkins-hbase4.apache.org,38433,1675918995805}] 2023-02-09 05:03:20,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 122f54af406924ee1baa6592304c4679, server=jenkins-hbase4.apache.org,33859,1675918995834}] 2023-02-09 05:03:20,851 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:20,851 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:20,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:03:20,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:20,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 33a7cf02a27c06f47fa4bfe393f8b21d, disabling compactions & flushes 2023-02-09 05:03:20,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. after waiting 0 ms 2023-02-09 05:03:20,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:20,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 432ad7357ee1ec322c688cf46abcb9cd, disabling compactions & flushes 2023-02-09 05:03:20,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. after waiting 0 ms 2023-02-09 05:03:20,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d. 2023-02-09 05:03:20,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 33a7cf02a27c06f47fa4bfe393f8b21d: Waiting for close lock at 1675919000911Running coprocessor pre-close hooks at 1675919000911Disabling compacts and flushes for region at 1675919000911Disabling writes for close at 1675919000911Writing region close event to WAL at 1675919000912 (+1 ms)Running coprocessor post-close hooks at 1675919000916 (+4 ms)Closed at 1675919000916 2023-02-09 05:03:20,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd. 2023-02-09 05:03:20,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 432ad7357ee1ec322c688cf46abcb9cd: Waiting for close lock at 1675919000913Running coprocessor pre-close hooks at 1675919000913Disabling compacts and flushes for region at 1675919000913Disabling writes for close at 1675919000913Writing region close event to WAL at 1675919000914 (+1 ms)Running coprocessor post-close hooks at 1675919000916 (+2 ms)Closed at 1675919000916 2023-02-09 05:03:20,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:20,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:20,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 93e6cca95845a69da56c80153f65963d, disabling compactions & flushes 2023-02-09 05:03:20,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. after waiting 0 ms 2023-02-09 05:03:20,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,917 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=33a7cf02a27c06f47fa4bfe393f8b21d, regionState=CLOSED 2023-02-09 05:03:20,918 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000917"}]},"ts":"1675919000917"} 2023-02-09 05:03:20,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:20,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:20,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0474cd6ce4681a15c755d0effff737ab, disabling compactions & flushes 2023-02-09 05:03:20,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. after waiting 0 ms 2023-02-09 05:03:20,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,918 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=432ad7357ee1ec322c688cf46abcb9cd, regionState=CLOSED 2023-02-09 05:03:20,918 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000918"}]},"ts":"1675919000918"} 2023-02-09 05:03:20,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-09 05:03:20,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure 33a7cf02a27c06f47fa4bfe393f8b21d, server=jenkins-hbase4.apache.org,38433,1675918995805 in 152 msec 2023-02-09 05:03:20,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-09 05:03:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,922 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 432ad7357ee1ec322c688cf46abcb9cd, server=jenkins-hbase4.apache.org,33859,1675918995834 in 160 msec 2023-02-09 05:03:20,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33a7cf02a27c06f47fa4bfe393f8b21d, UNASSIGN in 167 msec 2023-02-09 05:03:20,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d. 2023-02-09 05:03:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 93e6cca95845a69da56c80153f65963d: Waiting for close lock at 1675919000917Running coprocessor pre-close hooks at 1675919000917Disabling compacts and flushes for region at 1675919000917Disabling writes for close at 1675919000917Writing region close event to WAL at 1675919000918 (+1 ms)Running coprocessor post-close hooks at 1675919000922 (+4 ms)Closed at 1675919000922 2023-02-09 05:03:20,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=432ad7357ee1ec322c688cf46abcb9cd, UNASSIGN in 168 msec 2023-02-09 05:03:20,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:20,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 02c9246320a746fdd379e09775311b81, disabling compactions & flushes 2023-02-09 05:03:20,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. after waiting 0 ms 2023-02-09 05:03:20,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,924 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=93e6cca95845a69da56c80153f65963d, regionState=CLOSED 2023-02-09 05:03:20,924 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000924"}]},"ts":"1675919000924"} 2023-02-09 05:03:20,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-09 05:03:20,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:03:20,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 93e6cca95845a69da56c80153f65963d, server=jenkins-hbase4.apache.org,38433,1675918995805 in 160 msec 2023-02-09 05:03:20,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81. 2023-02-09 05:03:20,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 02c9246320a746fdd379e09775311b81: Waiting for close lock at 1675919000924Running coprocessor pre-close hooks at 1675919000924Disabling compacts and flushes for region at 1675919000924Disabling writes for close at 1675919000924Writing region close event to WAL at 1675919000924Running coprocessor post-close hooks at 1675919000927 (+3 ms)Closed at 1675919000927 2023-02-09 05:03:20,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=93e6cca95845a69da56c80153f65963d, UNASSIGN in 172 msec 2023-02-09 05:03:20,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 02c9246320a746fdd379e09775311b81 2023-02-09 05:03:20,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:20,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3bad2a73089572ab0abab2298d19d65f, disabling compactions & flushes 2023-02-09 05:03:20,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,928 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02c9246320a746fdd379e09775311b81, regionState=CLOSED 2023-02-09 05:03:20,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. after waiting 0 ms 2023-02-09 05:03:20,928 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675919000928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000928"}]},"ts":"1675919000928"} 2023-02-09 05:03:20,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab. 2023-02-09 05:03:20,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0474cd6ce4681a15c755d0effff737ab: Waiting for close lock at 1675919000918Running coprocessor pre-close hooks at 1675919000918Disabling compacts and flushes for region at 1675919000918Disabling writes for close at 1675919000918Writing region close event to WAL at 1675919000920 (+2 ms)Running coprocessor post-close hooks at 1675919000931 (+11 ms)Closed at 1675919000931 2023-02-09 05:03:20,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=43 2023-02-09 05:03:20,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=43, state=SUCCESS; CloseRegionProcedure 02c9246320a746fdd379e09775311b81, server=jenkins-hbase4.apache.org,38433,1675918995805 in 170 msec 2023-02-09 05:03:20,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:20,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:20,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 67e78fe7a85e34ecc9e1d7aed8e1dbd6, disabling compactions & flushes 2023-02-09 05:03:20,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. after waiting 0 ms 2023-02-09 05:03:20,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=02c9246320a746fdd379e09775311b81, UNASSIGN in 177 msec 2023-02-09 05:03:20,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,933 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0474cd6ce4681a15c755d0effff737ab, regionState=CLOSED 2023-02-09 05:03:20,933 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000933"}]},"ts":"1675919000933"} 2023-02-09 05:03:20,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-09 05:03:20,935 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 0474cd6ce4681a15c755d0effff737ab, server=jenkins-hbase4.apache.org,33859,1675918995834 in 168 msec 2023-02-09 05:03:20,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=0474cd6ce4681a15c755d0effff737ab, UNASSIGN in 181 msec 2023-02-09 05:03:20,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f. 2023-02-09 05:03:20,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3bad2a73089572ab0abab2298d19d65f: Waiting for close lock at 1675919000928Running coprocessor pre-close hooks at 1675919000928Disabling compacts and flushes for region at 1675919000928Disabling writes for close at 1675919000928Writing region close event to WAL at 1675919000930 (+2 ms)Running coprocessor post-close hooks at 1675919000936 (+6 ms)Closed at 1675919000936 2023-02-09 05:03:20,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:20,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9ff8c4b092cda73a08d1b1c24c4e7f91, disabling compactions & flushes 2023-02-09 05:03:20,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. after waiting 0 ms 2023-02-09 05:03:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,938 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3bad2a73089572ab0abab2298d19d65f, regionState=CLOSED 2023-02-09 05:03:20,938 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000938"}]},"ts":"1675919000938"} 2023-02-09 05:03:20,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6. 2023-02-09 05:03:20,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 67e78fe7a85e34ecc9e1d7aed8e1dbd6: Waiting for close lock at 1675919000932Running coprocessor pre-close hooks at 1675919000932Disabling compacts and flushes for region at 1675919000932Disabling writes for close at 1675919000933 (+1 ms)Writing region close event to WAL at 1675919000937 (+4 ms)Running coprocessor post-close hooks at 1675919000940 (+3 ms)Closed at 1675919000940 2023-02-09 05:03:20,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-09 05:03:20,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure 3bad2a73089572ab0abab2298d19d65f, server=jenkins-hbase4.apache.org,38433,1675918995805 in 181 msec 2023-02-09 05:03:20,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:20,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 122f54af406924ee1baa6592304c4679, disabling compactions & flushes 2023-02-09 05:03:20,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. after waiting 0 ms 2023-02-09 05:03:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,942 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=67e78fe7a85e34ecc9e1d7aed8e1dbd6, regionState=CLOSED 2023-02-09 05:03:20,942 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000942"}]},"ts":"1675919000942"} 2023-02-09 05:03:20,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3bad2a73089572ab0abab2298d19d65f, UNASSIGN in 187 msec 2023-02-09 05:03:20,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91. 2023-02-09 05:03:20,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9ff8c4b092cda73a08d1b1c24c4e7f91: Waiting for close lock at 1675919000938Running coprocessor pre-close hooks at 1675919000938Disabling compacts and flushes for region at 1675919000938Disabling writes for close at 1675919000938Writing region close event to WAL at 1675919000939 (+1 ms)Running coprocessor post-close hooks at 1675919000944 (+5 ms)Closed at 1675919000944 2023-02-09 05:03:20,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 05:03:20,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-09 05:03:20,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 67e78fe7a85e34ecc9e1d7aed8e1dbd6, server=jenkins-hbase4.apache.org,33859,1675918995834 in 180 msec 2023-02-09 05:03:20,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:20,945 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=9ff8c4b092cda73a08d1b1c24c4e7f91, regionState=CLOSED 2023-02-09 05:03:20,945 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000945"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000945"}]},"ts":"1675919000945"} 2023-02-09 05:03:20,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679. 2023-02-09 05:03:20,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 122f54af406924ee1baa6592304c4679: Waiting for close lock at 1675919000942Running coprocessor pre-close hooks at 1675919000942Disabling compacts and flushes for region at 1675919000942Disabling writes for close at 1675919000942Writing region close event to WAL at 1675919000942Running coprocessor post-close hooks at 1675919000945 (+3 ms)Closed at 1675919000945 2023-02-09 05:03:20,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=67e78fe7a85e34ecc9e1d7aed8e1dbd6, UNASSIGN in 191 msec 2023-02-09 05:03:20,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 122f54af406924ee1baa6592304c4679 2023-02-09 05:03:20,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:20,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc4eb96e00c3268767f2496010e195ee, disabling compactions & flushes 2023-02-09 05:03:20,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. after waiting 0 ms 2023-02-09 05:03:20,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=122f54af406924ee1baa6592304c4679, regionState=CLOSED 2023-02-09 05:03:20,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675919000947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000947"}]},"ts":"1675919000947"} 2023-02-09 05:03:20,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=38 2023-02-09 05:03:20,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=38, state=SUCCESS; CloseRegionProcedure 9ff8c4b092cda73a08d1b1c24c4e7f91, server=jenkins-hbase4.apache.org,38433,1675918995805 in 189 msec 2023-02-09 05:03:20,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=9ff8c4b092cda73a08d1b1c24c4e7f91, UNASSIGN in 195 msec 2023-02-09 05:03:20,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-09 05:03:20,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 122f54af406924ee1baa6592304c4679, server=jenkins-hbase4.apache.org,33859,1675918995834 in 177 msec 2023-02-09 05:03:20,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:20,951 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=122f54af406924ee1baa6592304c4679, UNASSIGN in 196 msec 2023-02-09 05:03:20,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee. 2023-02-09 05:03:20,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc4eb96e00c3268767f2496010e195ee: Waiting for close lock at 1675919000947Running coprocessor pre-close hooks at 1675919000947Disabling compacts and flushes for region at 1675919000947Disabling writes for close at 1675919000947Writing region close event to WAL at 1675919000948 (+1 ms)Running coprocessor post-close hooks at 1675919000951 (+3 ms)Closed at 1675919000951 2023-02-09 05:03:20,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:20,952 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bc4eb96e00c3268767f2496010e195ee, regionState=CLOSED 2023-02-09 05:03:20,952 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675919000952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919000952"}]},"ts":"1675919000952"} 2023-02-09 05:03:20,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-09 05:03:20,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure bc4eb96e00c3268767f2496010e195ee, server=jenkins-hbase4.apache.org,33859,1675918995834 in 192 msec 2023-02-09 05:03:20,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-09 05:03:20,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc4eb96e00c3268767f2496010e195ee, UNASSIGN in 200 msec 2023-02-09 05:03:20,956 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919000956"}]},"ts":"1675919000956"} 2023-02-09 05:03:20,957 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-09 05:03:20,958 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-09 05:03:20,959 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 211 msec 2023-02-09 05:03:21,053 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:21,053 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:21,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-09 05:03:21,055 INFO [Listener at localhost/37419] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-09 05:03:21,055 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:21,055 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:21,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,058 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:21,058 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:21,058 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:21,069 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:21,073 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/recovered.edits] 2023-02-09 05:03:21,073 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/recovered.edits] 2023-02-09 05:03:21,074 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/recovered.edits] 2023-02-09 05:03:21,074 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/recovered.edits] 2023-02-09 05:03:21,074 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/recovered.edits] 2023-02-09 05:03:21,074 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/recovered.edits] 2023-02-09 05:03:21,074 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/recovered.edits] 2023-02-09 05:03:21,075 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/recovered.edits] 2023-02-09 05:03:21,090 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/a49239b6f4064abba43672216000599d to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/a49239b6f4064abba43672216000599d 2023-02-09 05:03:21,090 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/e000ee46e55b4b5fab8bc11c15af157f to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/e000ee46e55b4b5fab8bc11c15af157f 2023-02-09 05:03:21,091 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/1435ecda645049f1b5bfa9c141416a35 2023-02-09 05:03:21,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/0e75f177a6a341d8bde5b594db203093 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/0e75f177a6a341d8bde5b594db203093 2023-02-09 05:03:21,092 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/05c90afad9a14c9584a7226a3c6b2774 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/05c90afad9a14c9584a7226a3c6b2774 2023-02-09 05:03:21,093 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/1be7b79790fb413da345c289ea4ead5c to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/1be7b79790fb413da345c289ea4ead5c 2023-02-09 05:03:21,093 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/06ad57774c154cb9bcbbdf5c33838e44 2023-02-09 05:03:21,094 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/b3dce87109a74a1fba96a28251482c42 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f1/b3dce87109a74a1fba96a28251482c42 2023-02-09 05:03:21,094 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f1/161df44d1e5d4efcafe376ebe4073079 2023-02-09 05:03:21,094 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f1/fb092b09217143509ca0a5d8665a2219 2023-02-09 05:03:21,094 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f1/e33a55f49dce407185b742d27c03a8b4 2023-02-09 05:03:21,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f1/74aa2d6e062744e696aed1a5cc37f579 2023-02-09 05:03:21,096 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f1/a58525e05c3c4b1ea0f8c48f591024da 2023-02-09 05:03:21,097 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/a4bbf88ec7704b12af6d54a223c01a5e to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f1/a4bbf88ec7704b12af6d54a223c01a5e 2023-02-09 05:03:21,097 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/recovered.edits/6.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679/recovered.edits/6.seqid 2023-02-09 05:03:21,098 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/122f54af406924ee1baa6592304c4679 2023-02-09 05:03:21,098 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:21,101 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/12ee6cf213914d6bb6404513f366b3e2 2023-02-09 05:03:21,101 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/84f55f65dfc5467e8e9e5052c1c41bd8 2023-02-09 05:03:21,101 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/38af16bedb0244a7a405603f39a8cb6f 2023-02-09 05:03:21,101 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/68a3fdbe080049a98cd0b1768efbcaeb to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/68a3fdbe080049a98cd0b1768efbcaeb 2023-02-09 05:03:21,101 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/72fbfa62bfbf4503ac19f35e2c96912a to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/72fbfa62bfbf4503ac19f35e2c96912a 2023-02-09 05:03:21,102 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/2845f7e036474043abfa880384dafe8e to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/2845f7e036474043abfa880384dafe8e 2023-02-09 05:03:21,102 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/recovered.edits] 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/0351f00ffe10430d9fbd85120eceffe8 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/0351f00ffe10430d9fbd85120eceffe8 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/e09b76b8d96a40e9858a3d5714434239 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/f2/e09b76b8d96a40e9858a3d5714434239 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/3e912375f33540aa888cf328abe2e17a to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/f2/3e912375f33540aa888cf328abe2e17a 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/f2/ca643a3f77614d5eb05aa47b407d310a 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/f2/9d892c26310c4513819e8bce4ed7c77a 2023-02-09 05:03:21,104 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/f2/cfa2efc1306c42218a4b441eedc035aa 2023-02-09 05:03:21,106 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/79966c1087144536813e7699a45dfaa8 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/f2/79966c1087144536813e7699a45dfaa8 2023-02-09 05:03:21,106 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/f2/953754a911ca42bb977ecb4525308f56 2023-02-09 05:03:21,109 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd/recovered.edits/12.seqid 2023-02-09 05:03:21,110 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91/recovered.edits/12.seqid 2023-02-09 05:03:21,110 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d/recovered.edits/12.seqid 2023-02-09 05:03:21,110 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee/recovered.edits/12.seqid 2023-02-09 05:03:21,110 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/432ad7357ee1ec322c688cf46abcb9cd 2023-02-09 05:03:21,110 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/9ff8c4b092cda73a08d1b1c24c4e7f91 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/33a7cf02a27c06f47fa4bfe393f8b21d 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d/recovered.edits/12.seqid 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc4eb96e00c3268767f2496010e195ee 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/372d3796ddbb4b64b052fb290b897927 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/372d3796ddbb4b64b052fb290b897927 2023-02-09 05:03:21,112 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f1, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/f2, FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/recovered.edits] 2023-02-09 05:03:21,113 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/93e6cca95845a69da56c80153f65963d 2023-02-09 05:03:21,114 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f/recovered.edits/12.seqid 2023-02-09 05:03:21,114 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab/recovered.edits/12.seqid 2023-02-09 05:03:21,114 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479 to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f1/3d5fe2b7765b40e584028387ff881479 2023-02-09 05:03:21,115 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/0474cd6ce4681a15c755d0effff737ab 2023-02-09 05:03:21,115 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/3bad2a73089572ab0abab2298d19d65f 2023-02-09 05:03:21,117 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/0ba1fa319eab4c5db22efcc4e54a875f 2023-02-09 05:03:21,119 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/2cbf537329ac47b3a43219aa57a2f05e to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/f2/2cbf537329ac47b3a43219aa57a2f05e 2023-02-09 05:03:21,119 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/recovered.edits/6.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81/recovered.edits/6.seqid 2023-02-09 05:03:21,120 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/02c9246320a746fdd379e09775311b81 2023-02-09 05:03:21,121 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/recovered.edits/12.seqid to hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/archive/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6/recovered.edits/12.seqid 2023-02-09 05:03:21,122 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/.tmp/data/default/testWithMockedMapReduceMultiRegion/67e78fe7a85e34ecc9e1d7aed8e1dbd6 2023-02-09 05:03:21,122 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-09 05:03:21,125 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,128 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-09 05:03:21,131 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,132 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,133 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919001132"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,134 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-09 05:03:21,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 122f54af406924ee1baa6592304c4679, NAME => 'testWithMockedMapReduceMultiRegion,,1675918997079.122f54af406924ee1baa6592304c4679.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 33a7cf02a27c06f47fa4bfe393f8b21d, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675918997079.33a7cf02a27c06f47fa4bfe393f8b21d.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 0474cd6ce4681a15c755d0effff737ab, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675918997079.0474cd6ce4681a15c755d0effff737ab.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 432ad7357ee1ec322c688cf46abcb9cd, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675918997079.432ad7357ee1ec322c688cf46abcb9cd.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 9ff8c4b092cda73a08d1b1c24c4e7f91, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675918997079.9ff8c4b092cda73a08d1b1c24c4e7f91.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 3bad2a73089572ab0abab2298d19d65f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675918997079.3bad2a73089572ab0abab2298d19d65f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => bc4eb96e00c3268767f2496010e195ee, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675918997079.bc4eb96e00c3268767f2496010e195ee.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 93e6cca95845a69da56c80153f65963d, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675918997079.93e6cca95845a69da56c80153f65963d.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 67e78fe7a85e34ecc9e1d7aed8e1dbd6, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675918997079.67e78fe7a85e34ecc9e1d7aed8e1dbd6.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 02c9246320a746fdd379e09775311b81, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675918997079.02c9246320a746fdd379e09775311b81.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-09 05:03:21,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-09 05:03:21,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675919001135"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:21,136 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-09 05:03:21,138 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-09 05:03:21,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 83 msec 2023-02-09 05:03:21,159 INFO [Listener at localhost/37419] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:21,160 INFO [Listener at localhost/37419] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:21,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36237] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-09 05:03:21,161 INFO [Listener at localhost/37419] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-09 05:03:21,161 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:21,161 INFO [Listener at localhost/37419] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:21,162 DEBUG [Listener at localhost/37419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0af21ea9 to 127.0.0.1:51781 2023-02-09 05:03:21,162 DEBUG [Listener at localhost/37419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,162 DEBUG [Listener at localhost/37419] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:21,162 DEBUG [Listener at localhost/37419] util.JVMClusterUtil(257): Found active master hash=667771725, stopped=false 2023-02-09 05:03:21,163 INFO [Listener at localhost/37419] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:21,165 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:21,165 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:21,165 INFO [Listener at localhost/37419] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:21,165 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:21,168 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:21,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:21,169 DEBUG [Listener at localhost/37419] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17405855 to 127.0.0.1:51781 2023-02-09 05:03:21,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:21,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:21,169 DEBUG [Listener at localhost/37419] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,169 INFO [Listener at localhost/37419] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38433,1675918995805' ***** 2023-02-09 05:03:21,169 INFO [Listener at localhost/37419] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:21,170 INFO [Listener at localhost/37419] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33859,1675918995834' ***** 2023-02-09 05:03:21,170 INFO [Listener at localhost/37419] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:21,170 INFO [RS:0;jenkins-hbase4:38433] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:21,170 INFO [RS:1;jenkins-hbase4:33859] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:21,170 INFO [RS:1;jenkins-hbase4:33859] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:21,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:21,170 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:21,170 INFO [RS:0;jenkins-hbase4:38433] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:21,171 DEBUG [RS:0;jenkins-hbase4:38433] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32c5a4cc to 127.0.0.1:51781 2023-02-09 05:03:21,171 DEBUG [RS:0;jenkins-hbase4:38433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:21,171 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 05:03:21,171 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-09 05:03:21,171 DEBUG [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 05:03:21,171 INFO [RS:1;jenkins-hbase4:33859] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:21,171 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(3304): Received CLOSE for b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:21,172 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:21,172 DEBUG [RS:1;jenkins-hbase4:33859] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e8c6183 to 127.0.0.1:51781 2023-02-09 05:03:21,172 DEBUG [RS:1;jenkins-hbase4:33859] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,172 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-09 05:03:21,172 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1479): Online Regions={b8cf61d93c608ed5a1645330581be4cc=hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc.} 2023-02-09 05:03:21,172 DEBUG [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1505): Waiting on b8cf61d93c608ed5a1645330581be4cc 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b8cf61d93c608ed5a1645330581be4cc, disabling compactions & flushes 2023-02-09 05:03:21,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:21,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. after waiting 0 ms 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:21,176 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:21,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b8cf61d93c608ed5a1645330581be4cc 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:21,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-09 05:03:21,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/.tmp/info/4e8013d28a9747299a832fa8e93192e0 2023-02-09 05:03:21,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/info/dfbe26bf92ad4c6cbb7550570fc796cc 2023-02-09 05:03:21,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/.tmp/info/4e8013d28a9747299a832fa8e93192e0 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/info/4e8013d28a9747299a832fa8e93192e0 2023-02-09 05:03:21,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/info/4e8013d28a9747299a832fa8e93192e0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:21,203 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfbe26bf92ad4c6cbb7550570fc796cc 2023-02-09 05:03:21,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b8cf61d93c608ed5a1645330581be4cc in 27ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:21,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/namespace/b8cf61d93c608ed5a1645330581be4cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:21,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:21,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b8cf61d93c608ed5a1645330581be4cc: Waiting for close lock at 1675919001172Running coprocessor pre-close hooks at 1675919001172Disabling compacts and flushes for region at 1675919001172Disabling writes for close at 1675919001176 (+4 ms)Obtaining lock to block concurrent updates at 1675919001176Preparing flush snapshotting stores in b8cf61d93c608ed5a1645330581be4cc at 1675919001176Finished memstore snapshotting hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675919001176Flushing stores of hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. at 1675919001177 (+1 ms)Flushing b8cf61d93c608ed5a1645330581be4cc/info: creating writer at 1675919001177Flushing b8cf61d93c608ed5a1645330581be4cc/info: appending metadata at 1675919001180 (+3 ms)Flushing b8cf61d93c608ed5a1645330581be4cc/info: closing flushed file at 1675919001180Flushing b8cf61d93c608ed5a1645330581be4cc/info: reopening flushed file at 1675919001198 (+18 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b8cf61d93c608ed5a1645330581be4cc in 27ms, sequenceid=6, compaction requested=false at 1675919001203 (+5 ms)Writing region close event to WAL at 1675919001204 (+1 ms)Running coprocessor post-close hooks at 1675919001209 (+5 ms)Closed at 1675919001217 (+8 ms) 2023-02-09 05:03:21,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675918996438.b8cf61d93c608ed5a1645330581be4cc. 2023-02-09 05:03:21,217 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:21,219 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:21,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/8aa1b65021594684a05eef544ba14871 2023-02-09 05:03:21,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa1b65021594684a05eef544ba14871 2023-02-09 05:03:21,239 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/table/b6f31ed4dd484abd9a3623458cc43ed0 2023-02-09 05:03:21,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6f31ed4dd484abd9a3623458cc43ed0 2023-02-09 05:03:21,244 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/info/dfbe26bf92ad4c6cbb7550570fc796cc as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/info/dfbe26bf92ad4c6cbb7550570fc796cc 2023-02-09 05:03:21,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfbe26bf92ad4c6cbb7550570fc796cc 2023-02-09 05:03:21,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/info/dfbe26bf92ad4c6cbb7550570fc796cc, entries=30, sequenceid=57, filesize=8.3 K 2023-02-09 05:03:21,250 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/rep_barrier/8aa1b65021594684a05eef544ba14871 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/rep_barrier/8aa1b65021594684a05eef544ba14871 2023-02-09 05:03:21,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa1b65021594684a05eef544ba14871 2023-02-09 05:03:21,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/rep_barrier/8aa1b65021594684a05eef544ba14871, entries=10, sequenceid=57, filesize=6.1 K 2023-02-09 05:03:21,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/.tmp/table/b6f31ed4dd484abd9a3623458cc43ed0 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/table/b6f31ed4dd484abd9a3623458cc43ed0 2023-02-09 05:03:21,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6f31ed4dd484abd9a3623458cc43ed0 2023-02-09 05:03:21,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/table/b6f31ed4dd484abd9a3623458cc43ed0, entries=13, sequenceid=57, filesize=6.1 K 2023-02-09 05:03:21,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 85ms, sequenceid=57, compaction requested=false 2023-02-09 05:03:21,266 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-09 05:03:21,267 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:21,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:21,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919001171Running coprocessor pre-close hooks at 1675919001171Disabling compacts and flushes for region at 1675919001171Disabling writes for close at 1675919001176 (+5 ms)Obtaining lock to block concurrent updates at 1675919001176Preparing flush snapshotting stores in 1588230740 at 1675919001176Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675919001177 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675919001177Flushing 1588230740/info: creating writer at 1675919001177Flushing 1588230740/info: appending metadata at 1675919001182 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675919001182Flushing 1588230740/rep_barrier: creating writer at 1675919001203 (+21 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675919001205 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675919001205Flushing 1588230740/table: creating writer at 1675919001228 (+23 ms)Flushing 1588230740/table: appending metadata at 1675919001230 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675919001230Flushing 1588230740/info: reopening flushed file at 1675919001245 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675919001251 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675919001256 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 85ms, sequenceid=57, compaction requested=false at 1675919001261 (+5 ms)Writing region close event to WAL at 1675919001262 (+1 ms)Running coprocessor post-close hooks at 1675919001267 (+5 ms)Closed at 1675919001268 (+1 ms) 2023-02-09 05:03:21,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:21,371 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38433,1675918995805; all regions closed. 2023-02-09 05:03:21,372 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33859,1675918995834; all regions closed. 2023-02-09 05:03:21,379 DEBUG [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs 2023-02-09 05:03:21,379 INFO [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38433%2C1675918995805.meta:.meta(num 1675918996378) 2023-02-09 05:03:21,379 DEBUG [RS:1;jenkins-hbase4:33859] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs 2023-02-09 05:03:21,379 INFO [RS:1;jenkins-hbase4:33859] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33859%2C1675918995834:(num 1675918996813) 2023-02-09 05:03:21,379 DEBUG [RS:1;jenkins-hbase4:33859] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,379 INFO [RS:1;jenkins-hbase4:33859] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:21,380 INFO [RS:1;jenkins-hbase4:33859] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:21,380 INFO [RS:1;jenkins-hbase4:33859] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:21,380 INFO [RS:1;jenkins-hbase4:33859] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:21,380 INFO [RS:1;jenkins-hbase4:33859] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:21,380 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:21,382 INFO [RS:1;jenkins-hbase4:33859] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33859 2023-02-09 05:03:21,385 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:21,385 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33859,1675918995834 2023-02-09 05:03:21,385 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:21,385 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:21,385 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2df57874 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,385 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:21,385 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5b5e5c36 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,385 DEBUG [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/oldWALs 2023-02-09 05:03:21,385 INFO [RS:0;jenkins-hbase4:38433] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38433%2C1675918995805:(num 1675918997139) 2023-02-09 05:03:21,386 DEBUG [RS:0;jenkins-hbase4:38433] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,386 INFO [RS:0;jenkins-hbase4:38433] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:21,386 INFO [RS:0;jenkins-hbase4:38433] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:21,386 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:21,388 INFO [RS:0;jenkins-hbase4:38433] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38433 2023-02-09 05:03:21,388 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33859,1675918995834] 2023-02-09 05:03:21,388 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33859,1675918995834; numProcessing=1 2023-02-09 05:03:21,389 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38433,1675918995805 2023-02-09 05:03:21,389 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:21,389 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ae8d917 rejected from java.util.concurrent.ThreadPoolExecutor@2ed75892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,390 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33859,1675918995834 already deleted, retry=false 2023-02-09 05:03:21,390 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33859,1675918995834 expired; onlineServers=1 2023-02-09 05:03:21,392 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38433,1675918995805] 2023-02-09 05:03:21,392 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38433,1675918995805; numProcessing=2 2023-02-09 05:03:21,393 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38433,1675918995805 already deleted, retry=false 2023-02-09 05:03:21,393 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38433,1675918995805 expired; onlineServers=0 2023-02-09 05:03:21,393 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36237,1675918995756' ***** 2023-02-09 05:03:21,393 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:21,395 DEBUG [M:0;jenkins-hbase4:36237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23f2f36c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:21,395 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36237,1675918995756 2023-02-09 05:03:21,395 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36237,1675918995756; all regions closed. 2023-02-09 05:03:21,395 DEBUG [M:0;jenkins-hbase4:36237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:21,395 DEBUG [M:0;jenkins-hbase4:36237] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:21,395 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:21,395 DEBUG [M:0;jenkins-hbase4:36237] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:21,396 INFO [M:0;jenkins-hbase4:36237] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:21,396 INFO [M:0;jenkins-hbase4:36237] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:21,396 INFO [M:0;jenkins-hbase4:36237] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:21,396 DEBUG [M:0;jenkins-hbase4:36237] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:21,396 INFO [M:0;jenkins-hbase4:36237] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:21,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918996007] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675918996007,5,FailOnTimeoutGroup] 2023-02-09 05:03:21,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918996007] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675918996007,5,FailOnTimeoutGroup] 2023-02-09 05:03:21,397 ERROR [M:0;jenkins-hbase4:36237] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:21,398 INFO [M:0;jenkins-hbase4:36237] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:21,398 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:21,398 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:21,398 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:21,398 DEBUG [M:0;jenkins-hbase4:36237] zookeeper.ZKUtil(398): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:21,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:21,398 WARN [M:0;jenkins-hbase4:36237] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:21,398 INFO [M:0;jenkins-hbase4:36237] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:21,399 INFO [M:0;jenkins-hbase4:36237] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:21,399 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:21,399 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:21,399 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:21,399 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:21,399 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:21,399 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-09 05:03:21,409 INFO [M:0;jenkins-hbase4:36237] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/adb295061296437bb7878f4177002bf2 2023-02-09 05:03:21,413 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/adb295061296437bb7878f4177002bf2 as hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/adb295061296437bb7878f4177002bf2 2023-02-09 05:03:21,417 INFO [M:0;jenkins-hbase4:36237] regionserver.HStore(1080): Added hdfs://localhost:38581/user/jenkins/test-data/a5c564e3-9efd-63a8-7edb-b3f5b7533e9c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/adb295061296437bb7878f4177002bf2, entries=53, sequenceid=357, filesize=10.7 K 2023-02-09 05:03:21,418 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false 2023-02-09 05:03:21,418 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:21,418 DEBUG [M:0;jenkins-hbase4:36237] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919001399Disabling compacts and flushes for region at 1675919001399Disabling writes for close at 1675919001399Obtaining lock to block concurrent updates at 1675919001399Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675919001399Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171153, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675919001399Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675919001400 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675919001401 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675919001403 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675919001403Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675919001414 (+11 ms)Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=357, compaction requested=false at 1675919001418 (+4 ms)Writing region close event to WAL at 1675919001418Closed at 1675919001418 2023-02-09 05:03:21,421 INFO [M:0;jenkins-hbase4:36237] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:21,421 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:21,422 INFO [M:0;jenkins-hbase4:36237] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36237 2023-02-09 05:03:21,424 DEBUG [M:0;jenkins-hbase4:36237] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36237,1675918995756 already deleted, retry=false 2023-02-09 05:03:21,567 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,567 INFO [M:0;jenkins-hbase4:36237] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36237,1675918995756; zookeeper connection closed. 2023-02-09 05:03:21,567 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b7ce588 rejected from java.util.concurrent.ThreadPoolExecutor@1f43723f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,568 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): master:36237-0x10037765ada0000, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,568 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17fde4d5 rejected from java.util.concurrent.ThreadPoolExecutor@1f43723f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,667 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,667 INFO [RS:0;jenkins-hbase4:38433] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38433,1675918995805; zookeeper connection closed. 2023-02-09 05:03:21,667 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36b84d97 rejected from java.util.concurrent.ThreadPoolExecutor@2ed75892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,667 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@728e5a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@728e5a 2023-02-09 05:03:21,667 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:38433-0x10037765ada0001, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,667 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e73da32 rejected from java.util.concurrent.ThreadPoolExecutor@2ed75892[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,767 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,767 INFO [RS:1;jenkins-hbase4:33859] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33859,1675918995834; zookeeper connection closed. 2023-02-09 05:03:21,767 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2392c937 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,768 DEBUG [Listener at localhost/37419-EventThread] zookeeper.ZKWatcher(600): regionserver:33859-0x10037765ada0002, quorum=127.0.0.1:51781, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:21,768 ERROR [Listener at localhost/37419-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25f1cf46 rejected from java.util.concurrent.ThreadPoolExecutor@29caf912[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:21,768 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3817d3e6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3817d3e6 2023-02-09 05:03:21,769 INFO [Listener at localhost/37419] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:21,769 WARN [Listener at localhost/37419] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:21,772 INFO [Listener at localhost/37419] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:21,875 WARN [BP-1210426331-172.31.14.131-1675918995131 heartbeating to localhost/127.0.0.1:38581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:21,877 WARN [BP-1210426331-172.31.14.131-1675918995131 heartbeating to localhost/127.0.0.1:38581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1210426331-172.31.14.131-1675918995131 (Datanode Uuid 89ff46ae-8765-4b7d-b65c-38c9a249466c) service to localhost/127.0.0.1:38581 2023-02-09 05:03:21,881 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/dfs/data/data3/current/BP-1210426331-172.31.14.131-1675918995131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:21,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/dfs/data/data4/current/BP-1210426331-172.31.14.131-1675918995131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:21,883 WARN [Listener at localhost/37419] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:21,887 INFO [Listener at localhost/37419] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:21,990 WARN [BP-1210426331-172.31.14.131-1675918995131 heartbeating to localhost/127.0.0.1:38581] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:21,991 WARN [BP-1210426331-172.31.14.131-1675918995131 heartbeating to localhost/127.0.0.1:38581] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1210426331-172.31.14.131-1675918995131 (Datanode Uuid db794d63-7d1c-4391-b04f-b9bfe561d8d8) service to localhost/127.0.0.1:38581 2023-02-09 05:03:21,995 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/dfs/data/data1/current/BP-1210426331-172.31.14.131-1675918995131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:21,995 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/cluster_9eadd7ea-478b-4d7d-a1ff-fdacbce62b75/dfs/data/data2/current/BP-1210426331-172.31.14.131-1675918995131] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:22,008 INFO [Listener at localhost/37419] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:22,128 INFO [Listener at localhost/37419] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:22,163 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:22,177 INFO [Listener at localhost/37419] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38581 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38581 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:38581 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:38581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36237,1675918995756)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:38581 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37419.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=638 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 267), ProcessCount=167 (was 167), AvailableMemoryMB=3726 (was 3793) 2023-02-09 05:03:22,187 INFO [Listener at localhost/37419] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=167, AvailableMemoryMB=3725 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.log.dir so I do NOT create it in target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a 2023-02-09 05:03:22,198 WARN [Listener at localhost/37419] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.tmp.dir so I do NOT create it in target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a 2023-02-09 05:03:22,198 WARN [Listener at localhost/37419] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5ad942a2-80a1-c354-4d1d-5bb2d20ce24b/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:22,198 DEBUG [Listener at localhost/37419] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf, deleteOnExit=true 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/test.cache.data in system properties and HBase conf 2023-02-09 05:03:22,198 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:22,199 DEBUG [Listener at localhost/37419] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:22,199 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:22,200 INFO [Listener at localhost/37419] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:22,204 WARN [Listener at localhost/37419] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:22,204 WARN [Listener at localhost/37419] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:22,244 WARN [Listener at localhost/37419] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 05:03:22,319 WARN [Listener at localhost/37419] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:22,321 INFO [Listener at localhost/37419] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:22,332 INFO [Listener at localhost/37419] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/java.io.tmpdir/Jetty_localhost_38915_hdfs____1gqo8y/webapp 2023-02-09 05:03:22,425 INFO [Listener at localhost/37419] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38915 2023-02-09 05:03:22,429 WARN [Listener at localhost/37419] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:22,430 WARN [Listener at localhost/37419] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:22,468 WARN [Listener at localhost/44701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:22,482 WARN [Listener at localhost/44701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:22,485 WARN [Listener at localhost/44701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:22,486 INFO [Listener at localhost/44701] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:22,491 INFO [Listener at localhost/44701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/java.io.tmpdir/Jetty_localhost_33515_datanode____.dkbjkw/webapp 2023-02-09 05:03:22,589 INFO [Listener at localhost/44701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33515 2023-02-09 05:03:22,599 WARN [Listener at localhost/36899] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:22,615 WARN [Listener at localhost/36899] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:22,619 WARN [Listener at localhost/36899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:22,620 INFO [Listener at localhost/36899] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:22,624 INFO [Listener at localhost/36899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/java.io.tmpdir/Jetty_localhost_44751_datanode____.ytss92/webapp 2023-02-09 05:03:22,698 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2f548ddf5a554a25: Processing first storage report for DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca from datanode 0a561464-e094-4ae0-8910-8f072b386d6b 2023-02-09 05:03:22,698 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2f548ddf5a554a25: from storage DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca node DatanodeRegistration(127.0.0.1:38293, datanodeUuid=0a561464-e094-4ae0-8910-8f072b386d6b, infoPort=40987, infoSecurePort=0, ipcPort=36899, storageInfo=lv=-57;cid=testClusterID;nsid=927569345;c=1675919002207), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:22,698 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2f548ddf5a554a25: Processing first storage report for DS-b2e93139-db27-4bc8-8809-19370851098d from datanode 0a561464-e094-4ae0-8910-8f072b386d6b 2023-02-09 05:03:22,698 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2f548ddf5a554a25: from storage DS-b2e93139-db27-4bc8-8809-19370851098d node DatanodeRegistration(127.0.0.1:38293, datanodeUuid=0a561464-e094-4ae0-8910-8f072b386d6b, infoPort=40987, infoSecurePort=0, ipcPort=36899, storageInfo=lv=-57;cid=testClusterID;nsid=927569345;c=1675919002207), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:22,725 INFO [Listener at localhost/36899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44751 2023-02-09 05:03:22,731 WARN [Listener at localhost/41791] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:22,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f6c9b7369124dd2: Processing first storage report for DS-2554ba56-a172-442b-afdd-61f46fcb29d5 from datanode 65c3f798-19a5-4a89-b5ac-1460b9b7bf7b 2023-02-09 05:03:22,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f6c9b7369124dd2: from storage DS-2554ba56-a172-442b-afdd-61f46fcb29d5 node DatanodeRegistration(127.0.0.1:39179, datanodeUuid=65c3f798-19a5-4a89-b5ac-1460b9b7bf7b, infoPort=33483, infoSecurePort=0, ipcPort=41791, storageInfo=lv=-57;cid=testClusterID;nsid=927569345;c=1675919002207), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:22,824 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3f6c9b7369124dd2: Processing first storage report for DS-02c067a2-ac30-4b93-ac3f-b58bc23151f8 from datanode 65c3f798-19a5-4a89-b5ac-1460b9b7bf7b 2023-02-09 05:03:22,824 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3f6c9b7369124dd2: from storage DS-02c067a2-ac30-4b93-ac3f-b58bc23151f8 node DatanodeRegistration(127.0.0.1:39179, datanodeUuid=65c3f798-19a5-4a89-b5ac-1460b9b7bf7b, infoPort=33483, infoSecurePort=0, ipcPort=41791, storageInfo=lv=-57;cid=testClusterID;nsid=927569345;c=1675919002207), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:22,837 DEBUG [Listener at localhost/41791] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a 2023-02-09 05:03:22,839 INFO [Listener at localhost/41791] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/zookeeper_0, clientPort=52839, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:22,840 INFO [Listener at localhost/41791] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52839 2023-02-09 05:03:22,841 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,841 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,852 INFO [Listener at localhost/41791] util.FSUtils(479): Created version file at hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356 with version=8 2023-02-09 05:03:22,852 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,853 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,854 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/hbase-staging 2023-02-09 05:03:22,855 INFO [Listener at localhost/41791] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:22,856 INFO [Listener at localhost/41791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33149 2023-02-09 05:03:22,857 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,858 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,858 INFO [Listener at localhost/41791] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33149 connecting to ZooKeeper ensemble=127.0.0.1:52839 2023-02-09 05:03:22,869 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:331490x0, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:22,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33149-0x1003776769c0000 connected 2023-02-09 05:03:22,885 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:22,885 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:22,885 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:22,887 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33149 2023-02-09 05:03:22,887 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33149 2023-02-09 05:03:22,888 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33149 2023-02-09 05:03:22,890 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33149 2023-02-09 05:03:22,890 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33149 2023-02-09 05:03:22,890 INFO [Listener at localhost/41791] master.HMaster(439): hbase.rootdir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356, hbase.cluster.distributed=false 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:22,904 INFO [Listener at localhost/41791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:22,905 INFO [Listener at localhost/41791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42093 2023-02-09 05:03:22,905 INFO [Listener at localhost/41791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:22,907 DEBUG [Listener at localhost/41791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:22,908 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,909 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,909 INFO [Listener at localhost/41791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42093 connecting to ZooKeeper ensemble=127.0.0.1:52839 2023-02-09 05:03:22,913 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:420930x0, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:22,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42093-0x1003776769c0001 connected 2023-02-09 05:03:22,914 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:22,915 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:22,915 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:22,916 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42093 2023-02-09 05:03:22,917 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42093 2023-02-09 05:03:22,920 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42093 2023-02-09 05:03:22,920 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42093 2023-02-09 05:03:22,920 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42093 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:22,931 INFO [Listener at localhost/41791] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:22,932 INFO [Listener at localhost/41791] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:22,932 INFO [Listener at localhost/41791] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40673 2023-02-09 05:03:22,933 INFO [Listener at localhost/41791] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:22,933 DEBUG [Listener at localhost/41791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:22,933 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,934 INFO [Listener at localhost/41791] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,935 INFO [Listener at localhost/41791] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40673 connecting to ZooKeeper ensemble=127.0.0.1:52839 2023-02-09 05:03:22,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:406730x0, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:22,939 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:406730x0, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:22,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40673-0x1003776769c0002 connected 2023-02-09 05:03:22,940 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:22,941 DEBUG [Listener at localhost/41791] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:22,943 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40673 2023-02-09 05:03:22,944 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40673 2023-02-09 05:03:22,946 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40673 2023-02-09 05:03:22,946 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40673 2023-02-09 05:03:22,946 DEBUG [Listener at localhost/41791] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40673 2023-02-09 05:03:22,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:22,949 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:22,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:22,953 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:22,953 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:22,953 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:22,953 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:22,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:22,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33149,1675919002855 from backup master directory 2023-02-09 05:03:22,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:22,958 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:22,958 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:22,958 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:22,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:22,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/hbase.id with ID: 43faa6c9-2d1d-4b46-ac8e-947f1e41ce7b 2023-02-09 05:03:22,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:22,981 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:22,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x37135bb4 to 127.0.0.1:52839 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:22,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13a931cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:22,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:22,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:22,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:22,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store-tmp 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:23,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:23,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:23,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919003004Disabling compacts and flushes for region at 1675919003004Disabling writes for close at 1675919003004Writing region close event to WAL at 1675919003004Closed at 1675919003004 2023-02-09 05:03:23,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/WALs/jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:23,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33149%2C1675919002855, suffix=, logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/WALs/jenkins-hbase4.apache.org,33149,1675919002855, archiveDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:23,021 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK] 2023-02-09 05:03:23,021 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK] 2023-02-09 05:03:23,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/WALs/jenkins-hbase4.apache.org,33149,1675919002855/jenkins-hbase4.apache.org%2C33149%2C1675919002855.1675919003007 2023-02-09 05:03:23,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK], DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK]] 2023-02-09 05:03:23,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:23,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,028 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,029 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:23,029 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:23,030 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,030 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:23,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:23,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63507288, jitterRate=-0.053667664527893066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:23,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675919003025Initializing all the Stores at 1675919003025Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919003025Cleaning up temporary data from old regions at 1675919003031 (+6 ms)Cleaning up detritus from prior splits at 1675919003031Region opened successfully at 1675919003034 (+3 ms) 2023-02-09 05:03:23,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:23,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:23,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:23,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:23,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:23,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:23,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:23,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:23,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:23,055 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:23,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:23,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:23,057 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:23,057 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:23,057 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:23,057 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33149,1675919002855, sessionid=0x1003776769c0000, setting cluster-up flag (Was=false) 2023-02-09 05:03:23,062 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:23,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:23,071 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:23,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:23,075 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/.tmp 2023-02-09 05:03:23,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:23,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919033078 2023-02-09 05:03:23,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:23,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:23,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:23,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:23,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:23,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:23,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,079 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:23,079 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:23,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:23,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919003080,5,FailOnTimeoutGroup] 2023-02-09 05:03:23,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919003080,5,FailOnTimeoutGroup] 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,080 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:23,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:23,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,090 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:23,091 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:23,091 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356 2023-02-09 05:03:23,099 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:23,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/info 2023-02-09 05:03:23,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:23,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:23,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:23,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:23,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:23,104 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/table 2023-02-09 05:03:23,104 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:23,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,105 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740 2023-02-09 05:03:23,105 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740 2023-02-09 05:03:23,107 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:23,108 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:23,109 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:23,109 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61850705, jitterRate=-0.0783526748418808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675919003099Initializing all the Stores at 1675919003100 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919003100Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919003100Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919003100Cleaning up temporary data from old regions at 1675919003106 (+6 ms)Cleaning up detritus from prior splits at 1675919003106Region opened successfully at 1675919003110 (+4 ms) 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:23,110 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:23,110 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:23,110 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919003110Disabling compacts and flushes for region at 1675919003110Disabling writes for close at 1675919003110Writing region close event to WAL at 1675919003110Closed at 1675919003110 2023-02-09 05:03:23,111 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:23,111 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:23,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:23,112 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:23,114 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:23,149 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(952): ClusterId : 43faa6c9-2d1d-4b46-ac8e-947f1e41ce7b 2023-02-09 05:03:23,149 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(952): ClusterId : 43faa6c9-2d1d-4b46-ac8e-947f1e41ce7b 2023-02-09 05:03:23,149 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:23,149 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:23,152 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:23,152 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:23,152 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:23,152 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:23,154 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:23,156 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:23,157 DEBUG [RS:0;jenkins-hbase4:42093] zookeeper.ReadOnlyZKClient(139): Connect 0x688e9daf to 127.0.0.1:52839 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:23,157 DEBUG [RS:1;jenkins-hbase4:40673] zookeeper.ReadOnlyZKClient(139): Connect 0x7d2bbf17 to 127.0.0.1:52839 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:23,165 DEBUG [RS:0;jenkins-hbase4:42093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66496ece, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:23,165 DEBUG [RS:0;jenkins-hbase4:42093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6276f6df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:23,167 DEBUG [RS:1;jenkins-hbase4:40673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73ec4ec2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:23,167 DEBUG [RS:1;jenkins-hbase4:40673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77d3d467, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:23,174 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42093 2023-02-09 05:03:23,174 INFO [RS:0;jenkins-hbase4:42093] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:23,174 INFO [RS:0;jenkins-hbase4:42093] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:23,174 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:23,174 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33149,1675919002855 with isa=jenkins-hbase4.apache.org/172.31.14.131:42093, startcode=1675919002903 2023-02-09 05:03:23,174 DEBUG [RS:0;jenkins-hbase4:42093] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:23,176 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39795, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:23,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,178 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356 2023-02-09 05:03:23,178 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44701 2023-02-09 05:03:23,178 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:23,179 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:23,180 DEBUG [RS:0;jenkins-hbase4:42093] zookeeper.ZKUtil(162): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,180 WARN [RS:0;jenkins-hbase4:42093] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:23,180 INFO [RS:0;jenkins-hbase4:42093] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:23,180 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,181 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42093,1675919002903] 2023-02-09 05:03:23,183 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40673 2023-02-09 05:03:23,183 INFO [RS:1;jenkins-hbase4:40673] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:23,184 INFO [RS:1;jenkins-hbase4:40673] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:23,184 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:23,184 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33149,1675919002855 with isa=jenkins-hbase4.apache.org/172.31.14.131:40673, startcode=1675919002930 2023-02-09 05:03:23,185 DEBUG [RS:1;jenkins-hbase4:40673] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:23,185 DEBUG [RS:0;jenkins-hbase4:42093] zookeeper.ZKUtil(162): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,186 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50273, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:23,186 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:23,186 INFO [RS:0;jenkins-hbase4:42093] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:23,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,187 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356 2023-02-09 05:03:23,187 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:44701 2023-02-09 05:03:23,187 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:23,188 INFO [RS:0;jenkins-hbase4:42093] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:23,188 INFO [RS:0;jenkins-hbase4:42093] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:23,188 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,188 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:23,189 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,190 DEBUG [RS:0;jenkins-hbase4:42093] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,191 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,191 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,191 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,192 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:23,192 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:23,192 DEBUG [RS:1;jenkins-hbase4:40673] zookeeper.ZKUtil(162): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,192 WARN [RS:1;jenkins-hbase4:40673] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:23,192 INFO [RS:1;jenkins-hbase4:40673] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:23,192 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40673,1675919002930] 2023-02-09 05:03:23,192 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1947): logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,198 DEBUG [RS:1;jenkins-hbase4:40673] zookeeper.ZKUtil(162): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,198 DEBUG [RS:1;jenkins-hbase4:40673] zookeeper.ZKUtil(162): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,199 DEBUG [RS:1;jenkins-hbase4:40673] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:23,199 INFO [RS:1;jenkins-hbase4:40673] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:23,204 INFO [RS:1;jenkins-hbase4:40673] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:23,204 INFO [RS:1;jenkins-hbase4:40673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:23,204 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,204 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:23,205 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,205 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,205 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,205 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,205 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,205 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,206 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:23,206 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,206 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,206 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,206 DEBUG [RS:1;jenkins-hbase4:40673] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:23,207 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,207 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,207 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,209 INFO [RS:0;jenkins-hbase4:42093] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:23,209 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42093,1675919002903-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,220 INFO [RS:1;jenkins-hbase4:40673] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:23,220 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40673,1675919002930-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,220 INFO [RS:0;jenkins-hbase4:42093] regionserver.Replication(203): jenkins-hbase4.apache.org,42093,1675919002903 started 2023-02-09 05:03:23,220 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42093,1675919002903, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42093, sessionid=0x1003776769c0001 2023-02-09 05:03:23,220 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:23,220 DEBUG [RS:0;jenkins-hbase4:42093] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,220 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42093,1675919002903' 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42093,1675919002903' 2023-02-09 05:03:23,221 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:23,222 DEBUG [RS:0;jenkins-hbase4:42093] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:23,222 DEBUG [RS:0;jenkins-hbase4:42093] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:23,222 INFO [RS:0;jenkins-hbase4:42093] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:23,222 INFO [RS:0;jenkins-hbase4:42093] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:23,230 INFO [RS:1;jenkins-hbase4:40673] regionserver.Replication(203): jenkins-hbase4.apache.org,40673,1675919002930 started 2023-02-09 05:03:23,230 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40673,1675919002930, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40673, sessionid=0x1003776769c0002 2023-02-09 05:03:23,230 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:23,230 DEBUG [RS:1;jenkins-hbase4:40673] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,230 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40673,1675919002930' 2023-02-09 05:03:23,230 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40673,1675919002930' 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:23,231 DEBUG [RS:1;jenkins-hbase4:40673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:23,232 DEBUG [RS:1;jenkins-hbase4:40673] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:23,232 INFO [RS:1;jenkins-hbase4:40673] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:23,232 INFO [RS:1;jenkins-hbase4:40673] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:23,264 DEBUG [jenkins-hbase4:33149] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:23,264 DEBUG [jenkins-hbase4:33149] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:23,265 DEBUG [jenkins-hbase4:33149] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:23,265 DEBUG [jenkins-hbase4:33149] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:23,265 DEBUG [jenkins-hbase4:33149] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:23,266 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42093,1675919002903, state=OPENING 2023-02-09 05:03:23,267 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:23,268 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42093,1675919002903}] 2023-02-09 05:03:23,271 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:23,424 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,425 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:23,426 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:23,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:23,430 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:23,431 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42093%2C1675919002903.meta, suffix=.meta, logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,42093,1675919002903, archiveDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs, maxLogs=32 2023-02-09 05:03:23,444 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK] 2023-02-09 05:03:23,444 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK] 2023-02-09 05:03:23,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,42093,1675919002903/jenkins-hbase4.apache.org%2C42093%2C1675919002903.meta.1675919003431.meta 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK], DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK]] 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:23,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:23,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:23,448 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:23,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/info 2023-02-09 05:03:23,448 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/info 2023-02-09 05:03:23,449 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:23,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,449 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:23,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:23,450 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:23,450 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:23,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,450 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:23,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/table 2023-02-09 05:03:23,451 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/table 2023-02-09 05:03:23,451 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:23,452 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,452 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740 2023-02-09 05:03:23,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740 2023-02-09 05:03:23,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:23,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:23,456 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75242497, jitterRate=0.1212005764245987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:23,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675919003447Writing region info on filesystem at 1675919003447Initializing all the Stores at 1675919003447Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919003447Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919003447Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919003448 (+1 ms)Cleaning up temporary data from old regions at 1675919003454 (+6 ms)Cleaning up detritus from prior splits at 1675919003454Running coprocessor post-open hooks at 1675919003456 (+2 ms)Region opened successfully at 1675919003456 2023-02-09 05:03:23,457 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675919003424 2023-02-09 05:03:23,460 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:23,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:23,461 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42093,1675919002903, state=OPEN 2023-02-09 05:03:23,463 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:23,463 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:23,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:23,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42093,1675919002903 in 195 msec 2023-02-09 05:03:23,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:23,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-09 05:03:23,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 390 msec 2023-02-09 05:03:23,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675919002949, completionTime=-1 2023-02-09 05:03:23,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:23,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:23,469 DEBUG [hconnection-0x6dcdc7e1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:23,472 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:23,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:23,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919063474 2023-02-09 05:03:23,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919123474 2023-02-09 05:03:23,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33149,1675919002855-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33149,1675919002855-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33149,1675919002855-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33149, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:23,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:23,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:23,482 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:23,482 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:23,483 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:23,484 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,484 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f empty. 2023-02-09 05:03:23,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:23,492 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:23,493 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a9fa9e279aca897a55154a34034b3f0f, NAME => 'hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a9fa9e279aca897a55154a34034b3f0f, disabling compactions & flushes 2023-02-09 05:03:23,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. after waiting 0 ms 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,502 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,502 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a9fa9e279aca897a55154a34034b3f0f: Waiting for close lock at 1675919003502Disabling compacts and flushes for region at 1675919003502Disabling writes for close at 1675919003502Writing region close event to WAL at 1675919003502Closed at 1675919003502 2023-02-09 05:03:23,504 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:23,504 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919003504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919003504"}]},"ts":"1675919003504"} 2023-02-09 05:03:23,507 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:23,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:23,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919003507"}]},"ts":"1675919003507"} 2023-02-09 05:03:23,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:23,512 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:23,512 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:23,512 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:23,512 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:23,513 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a9fa9e279aca897a55154a34034b3f0f, ASSIGN}] 2023-02-09 05:03:23,514 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a9fa9e279aca897a55154a34034b3f0f, ASSIGN 2023-02-09 05:03:23,515 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a9fa9e279aca897a55154a34034b3f0f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42093,1675919002903; forceNewPlan=false, retain=false 2023-02-09 05:03:23,665 INFO [jenkins-hbase4:33149] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:23,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a9fa9e279aca897a55154a34034b3f0f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919003665"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919003665"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919003665"}]},"ts":"1675919003665"} 2023-02-09 05:03:23,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a9fa9e279aca897a55154a34034b3f0f, server=jenkins-hbase4.apache.org,42093,1675919002903}] 2023-02-09 05:03:23,822 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,823 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42093%2C1675919002903, suffix=, logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,42093,1675919002903, archiveDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs, maxLogs=32 2023-02-09 05:03:23,836 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK] 2023-02-09 05:03:23,836 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK] 2023-02-09 05:03:23,838 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,42093,1675919002903/jenkins-hbase4.apache.org%2C42093%2C1675919002903.1675919003823 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK], DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK]] 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a9fa9e279aca897a55154a34034b3f0f, NAME => 'hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,838 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,839 INFO [StoreOpener-a9fa9e279aca897a55154a34034b3f0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,840 DEBUG [StoreOpener-a9fa9e279aca897a55154a34034b3f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/info 2023-02-09 05:03:23,840 DEBUG [StoreOpener-a9fa9e279aca897a55154a34034b3f0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/info 2023-02-09 05:03:23,841 INFO [StoreOpener-a9fa9e279aca897a55154a34034b3f0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9fa9e279aca897a55154a34034b3f0f columnFamilyName info 2023-02-09 05:03:23,841 INFO [StoreOpener-a9fa9e279aca897a55154a34034b3f0f-1] regionserver.HStore(310): Store=a9fa9e279aca897a55154a34034b3f0f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:23,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:23,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:23,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a9fa9e279aca897a55154a34034b3f0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73394021, jitterRate=0.09365613758563995}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:23,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a9fa9e279aca897a55154a34034b3f0f: Running coprocessor pre-open hook at 1675919003838Writing region info on filesystem at 1675919003838Initializing all the Stores at 1675919003839 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919003839Cleaning up temporary data from old regions at 1675919003842 (+3 ms)Cleaning up detritus from prior splits at 1675919003842Running coprocessor post-open hooks at 1675919003846 (+4 ms)Region opened successfully at 1675919003846 2023-02-09 05:03:23,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f., pid=6, masterSystemTime=1675919003819 2023-02-09 05:03:23,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,849 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:23,849 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a9fa9e279aca897a55154a34034b3f0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:23,849 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919003849"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919003849"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919003849"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919003849"}]},"ts":"1675919003849"} 2023-02-09 05:03:23,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:23,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a9fa9e279aca897a55154a34034b3f0f, server=jenkins-hbase4.apache.org,42093,1675919002903 in 184 msec 2023-02-09 05:03:23,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:23,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a9fa9e279aca897a55154a34034b3f0f, ASSIGN in 340 msec 2023-02-09 05:03:23,854 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:23,854 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919003854"}]},"ts":"1675919003854"} 2023-02-09 05:03:23,855 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:23,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:23,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 377 msec 2023-02-09 05:03:23,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:23,883 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:23,883 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:23,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:23,896 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:23,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-09 05:03:23,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:23,906 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:23,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-09 05:03:23,916 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:23,918 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.960sec 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33149,1675919002855-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:23,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33149,1675919002855-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:23,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:23,949 DEBUG [Listener at localhost/41791] zookeeper.ReadOnlyZKClient(139): Connect 0x7bfe9df9 to 127.0.0.1:52839 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:23,956 DEBUG [Listener at localhost/41791] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e08612e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:23,958 DEBUG [hconnection-0x1941506d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:23,961 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:23,962 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:23,962 DEBUG [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:23,962 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:23,963 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:23,965 DEBUG [Listener at localhost/41791] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:23,968 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36028, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:23,969 INFO [Listener at localhost/41791] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 05:03:23,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 05:03:23,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:23,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:36028 deadline: 1675919063969, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-09 05:03:23,970 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-09 05:03:23,970 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:23,971 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:23,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:23,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:23,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:23,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-09 05:03:23,975 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:23,975 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:23,975 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:23,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:23,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:23,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 empty. 2023-02-09 05:03:23,977 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:23,977 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 05:03:23,985 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:23,986 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => bda65966b80218c7f0d71a096b202532, NAME => 'testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing bda65966b80218c7f0d71a096b202532, disabling compactions & flushes 2023-02-09 05:03:23,994 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. after waiting 0 ms 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:23,994 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:23,994 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for bda65966b80218c7f0d71a096b202532: Waiting for close lock at 1675919003994Disabling compacts and flushes for region at 1675919003994Disabling writes for close at 1675919003994Writing region close event to WAL at 1675919003994Closed at 1675919003994 2023-02-09 05:03:23,996 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:23,997 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675919003997"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919003997"}]},"ts":"1675919003997"} 2023-02-09 05:03:23,998 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:23,999 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:23,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919003999"}]},"ts":"1675919003999"} 2023-02-09 05:03:24,000 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-09 05:03:24,003 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:24,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:24,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:24,004 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:24,005 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, ASSIGN}] 2023-02-09 05:03:24,006 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, ASSIGN 2023-02-09 05:03:24,007 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42093,1675919002903; forceNewPlan=false, retain=false 2023-02-09 05:03:24,076 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:24,077 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:24,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:24,157 INFO [jenkins-hbase4:33149] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:24,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bda65966b80218c7f0d71a096b202532, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675919004157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919004157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919004157"}]},"ts":"1675919004157"} 2023-02-09 05:03:24,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bda65966b80218c7f0d71a096b202532, server=jenkins-hbase4.apache.org,42093,1675919002903}] 2023-02-09 05:03:24,233 INFO [RS:1;jenkins-hbase4:40673] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40673%2C1675919002930, suffix=, logDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,40673,1675919002930, archiveDir=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs, maxLogs=32 2023-02-09 05:03:24,251 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK] 2023-02-09 05:03:24,251 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK] 2023-02-09 05:03:24,252 INFO [RS:1;jenkins-hbase4:40673] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/WALs/jenkins-hbase4.apache.org,40673,1675919002930/jenkins-hbase4.apache.org%2C40673%2C1675919002930.1675919004233 2023-02-09 05:03:24,253 DEBUG [RS:1;jenkins-hbase4:40673] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39179,DS-2554ba56-a172-442b-afdd-61f46fcb29d5,DISK], DatanodeInfoWithStorage[127.0.0.1:38293,DS-e2a6c7b8-46b2-49e2-8dc9-78d58e8cdcca,DISK]] 2023-02-09 05:03:24,278 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:24,278 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:24,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:24,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bda65966b80218c7f0d71a096b202532, NAME => 'testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,315 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,316 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1 2023-02-09 05:03:24,316 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1 2023-02-09 05:03:24,317 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda65966b80218c7f0d71a096b202532 columnFamilyName f1 2023-02-09 05:03:24,317 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(310): Store=bda65966b80218c7f0d71a096b202532/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:24,317 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,318 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2 2023-02-09 05:03:24,318 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2 2023-02-09 05:03:24,319 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda65966b80218c7f0d71a096b202532 columnFamilyName f2 2023-02-09 05:03:24,319 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(310): Store=bda65966b80218c7f0d71a096b202532/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:24,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:24,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:24,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:24,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bda65966b80218c7f0d71a096b202532; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59999758, jitterRate=-0.10593393445014954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:24,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bda65966b80218c7f0d71a096b202532: Running coprocessor pre-open hook at 1675919004314Writing region info on filesystem at 1675919004314Initializing all the Stores at 1675919004315 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919004315Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919004315Cleaning up temporary data from old regions at 1675919004321 (+6 ms)Cleaning up detritus from prior splits at 1675919004321Running coprocessor post-open hooks at 1675919004324 (+3 ms)Region opened successfully at 1675919004324 2023-02-09 05:03:24,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532., pid=12, masterSystemTime=1675919004310 2023-02-09 05:03:24,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bda65966b80218c7f0d71a096b202532, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,327 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675919004326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919004326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919004326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919004326"}]},"ts":"1675919004326"} 2023-02-09 05:03:24,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 05:03:24,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bda65966b80218c7f0d71a096b202532, server=jenkins-hbase4.apache.org,42093,1675919002903 in 169 msec 2023-02-09 05:03:24,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 05:03:24,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, ASSIGN in 324 msec 2023-02-09 05:03:24,331 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:24,331 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919004331"}]},"ts":"1675919004331"} 2023-02-09 05:03:24,332 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-09 05:03:24,334 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:24,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 362 msec 2023-02-09 05:03:24,580 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:24,580 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:24,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:24,581 INFO [Listener at localhost/41791] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-09 05:03:24,581 DEBUG [Listener at localhost/41791] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-09 05:03:24,582 INFO [Listener at localhost/41791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:24,583 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-09 05:03:24,584 INFO [Listener at localhost/41791] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:24,584 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-09 05:03:24,584 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:24,616 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42093] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,707 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:24,707 INFO [Listener at localhost/41791] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:24,708 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:24,708 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:24,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 05:03:24,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675919004709 (current time:1675919004709). 2023-02-09 05:03:24,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:24,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] zookeeper.ReadOnlyZKClient(139): Connect 0x643e78d0 to 127.0.0.1:52839 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:24,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b2d17c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:24,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:24,715 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x643e78d0 to 127.0.0.1:52839 2023-02-09 05:03:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:24,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:24,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 05:03:24,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 05:03:24,763 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 05:03:24,763 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675919604763 2023-02-09 05:03:24,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-09 05:03:24,763 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,764 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:24,764 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:24,765 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-09 05:03:24,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 05:03:24,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 6 msec 2023-02-09 05:03:24,766 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 05:03:24,767 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675919604767 2023-02-09 05:03:24,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,776 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 05:03:24,776 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:24,777 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 05:03:24,777 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 05:03:24,859 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,860 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,861 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:24,861 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:24,861 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:24,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:24,861 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,861 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-09 05:03:24,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,863 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 05:03:24,863 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:24,863 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40673,1675919002930' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 05:03:24,864 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42093,1675919002903' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 05:03:24,864 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:24,865 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:24,865 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:24,866 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,867 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,867 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 05:03:24,867 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,867 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:24,867 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:24,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,870 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:24,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:24,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42093,1675919002903' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 05:03:24,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4efa95ed[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:24,871 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 05:03:24,871 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,873 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,873 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:24,873 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:24,874 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 05:03:24,874 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:24,874 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,874 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. started... 2023-02-09 05:03:24,874 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bda65966b80218c7f0d71a096b202532 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 05:03:24,874 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:24,874 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 05:03:24,874 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40673,1675919002930' in zk 2023-02-09 05:03:24,876 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:24,876 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:24,876 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 05:03:24,890 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f1/522dfe488d7741cbb6bfcce0400c7734 2023-02-09 05:03:24,908 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f2/8434171de0f2428da04172cdc354d943 2023-02-09 05:03:24,913 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f1/522dfe488d7741cbb6bfcce0400c7734 as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734 2023-02-09 05:03:24,918 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:24,918 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f2/8434171de0f2428da04172cdc354d943 as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943 2023-02-09 05:03:24,923 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:24,924 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bda65966b80218c7f0d71a096b202532 in 50ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-09 05:03:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bda65966b80218c7f0d71a096b202532: 2023-02-09 05:03:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:24,924 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734] hfiles 2023-02-09 05:03:24,925 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,925 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943] hfiles 2023-02-09 05:03:24,925 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,930 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. completed. 2023-02-09 05:03:24,930 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:24,930 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 05:03:24,930 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 05:03:24,930 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,930 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 05:03:24,931 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42093,1675919002903' in zk 2023-02-09 05:03:24,932 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,932 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:24,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:24,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:24,932 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:24,932 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 05:03:24,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:24,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:24,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42093,1675919002903': 2023-02-09 05:03:24,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42093,1675919002903' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:24,936 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 05:03:24,936 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:24,936 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:24,936 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,936 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:24,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:24,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:24,938 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:24,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:24,938 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:24,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:24,939 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:24,941 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,941 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,947 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:24,947 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:24,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:24,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:24,947 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:24,947 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:24,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:24,947 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:24,947 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:24,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:24,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:24,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,948 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,995 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-09 05:03:24,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,995 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:24,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675919004763Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675919004948 (+185 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675919004948Writing data manifest for testWithMockedMapReduceSingleRegion at 1675919004954 (+6 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675919004961 (+7 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675919004995 (+34 ms) 2023-02-09 05:03:24,997 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-09 05:03:24,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 233 msec 2023-02-09 05:03:25,067 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:25,068 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,068 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-09 05:03:25,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:25,069 INFO [Listener at localhost/41791] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:25,069 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,069 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,074 INFO [Listener at localhost/41791] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:25,078 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:25,110 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42093] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,213 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:25,216 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,217 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:25,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,220 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-09 05:03:25,220 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:25,221 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-09 05:03:25,221 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 05:03:25,222 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,222 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,223 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:25,223 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:25,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:25,223 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,224 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,224 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,227 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 05:03:25,227 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:25,227 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40673,1675919002930' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 05:03:25,228 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:25,229 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,229 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. started... 2023-02-09 05:03:25,229 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bda65966b80218c7f0d71a096b202532 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 05:03:25,230 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,230 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,230 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:25,245 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f1/ce3ff0c89bb046dc934bb700314262a0 2023-02-09 05:03:25,264 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f2/88f6f67c261d4292a64eea923d043f5a 2023-02-09 05:03:25,268 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f1/ce3ff0c89bb046dc934bb700314262a0 as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/ce3ff0c89bb046dc934bb700314262a0 2023-02-09 05:03:25,282 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/ce3ff0c89bb046dc934bb700314262a0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:25,283 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/.tmp/f2/88f6f67c261d4292a64eea923d043f5a as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/88f6f67c261d4292a64eea923d043f5a 2023-02-09 05:03:25,287 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/88f6f67c261d4292a64eea923d043f5a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:25,287 INFO [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bda65966b80218c7f0d71a096b202532 in 58ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:25,288 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bda65966b80218c7f0d71a096b202532: 2023-02-09 05:03:25,288 DEBUG [rs(jenkins-hbase4.apache.org,42093,1675919002903)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 05:03:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 05:03:25,289 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,289 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-09 05:03:25,289 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42093,1675919002903' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-09 05:03:25,291 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,291 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:25,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42093,1675919002903' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-09 05:03:25,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ac518ea[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:25,293 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 05:03:25,293 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40673,1675919002930' in zk 2023-02-09 05:03:25,295 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,295 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:25,295 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42093,1675919002903' in zk 2023-02-09 05:03:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:25,296 DEBUG [member: 'jenkins-hbase4.apache.org,40673,1675919002930' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 05:03:25,297 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,297 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:25,297 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:25,297 DEBUG [member: 'jenkins-hbase4.apache.org,42093,1675919002903' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-09 05:03:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:25,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42093,1675919002903': 2023-02-09 05:03:25,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42093,1675919002903' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:25,300 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-09 05:03:25,300 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:25,300 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:25,300 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,300 INFO [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:25,303 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,303 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:25,303 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:25,303 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:25,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,304 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:25,304 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:25,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:25,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,304 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:25,306 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,306 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:25,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:25,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:25,309 DEBUG [(jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-09 05:03:25,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:25,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:25,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:25,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:25,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:25,309 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,310 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:25,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:25,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:25,310 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,410 DEBUG [Listener at localhost/41791] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:25,410 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,410 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:25,416 INFO [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675919004709 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:25,416 DEBUG [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5/data/default/testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,417 INFO [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(239): region to add: bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,417 INFO [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(585): clone region=bda65966b80218c7f0d71a096b202532 as bda65966b80218c7f0d71a096b202532 in snapshot testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,418 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bda65966b80218c7f0d71a096b202532, NAME => 'testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5 2023-02-09 05:03:25,425 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:25,425 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 522dfe488d7741cbb6bfcce0400c7734 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,427 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8434171de0f2428da04172cdc354d943 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bda65966b80218c7f0d71a096b202532, disabling compactions & flushes 2023-02-09 05:03:25,429 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. after waiting 0 ms 2023-02-09 05:03:25,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,429 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bda65966b80218c7f0d71a096b202532: Waiting for close lock at 1675919005429Disabling compacts and flushes for region at 1675919005429Disabling writes for close at 1675919005429Writing region close event to WAL at 1675919005429Closed at 1675919005429 2023-02-09 05:03:25,430 INFO [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675919004709 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:25,430 DEBUG [Listener at localhost/41791] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5 2023-02-09 05:03:25,430 DEBUG [Listener at localhost/41791] util.CommonFSUtils(682): File system contents for path hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5 2023-02-09 05:03:25,430 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:25,431 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:25,431 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-09 05:03:25,432 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |----------bda65966b80218c7f0d71a096b202532/ 2023-02-09 05:03:25,432 DEBUG [Listener at localhost/41791] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:25,432 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:25,433 DEBUG [Listener at localhost/41791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bda65966b80218c7f0d71a096b202532-522dfe488d7741cbb6bfcce0400c7734 2023-02-09 05:03:25,433 DEBUG [Listener at localhost/41791] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:25,433 DEBUG [Listener at localhost/41791] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bda65966b80218c7f0d71a096b202532-8434171de0f2428da04172cdc354d943 2023-02-09 05:03:25,445 INFO [Listener at localhost/41791] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 05:03:25,449 DEBUG [Listener at localhost/41791] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:25,449 INFO [Listener at localhost/41791] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:25,450 DEBUG [Listener at localhost/41791] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:25,452 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,453 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1 2023-02-09 05:03:25,453 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda65966b80218c7f0d71a096b202532 columnFamilyName f1 2023-02-09 05:03:25,458 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(539): loaded hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/testWithMockedMapReduceSingleRegion=bda65966b80218c7f0d71a096b202532-522dfe488d7741cbb6bfcce0400c7734 2023-02-09 05:03:25,458 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(310): Store=bda65966b80218c7f0d71a096b202532/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:25,458 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,459 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2 2023-02-09 05:03:25,459 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda65966b80218c7f0d71a096b202532 columnFamilyName f2 2023-02-09 05:03:25,472 DEBUG [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(539): loaded hdfs://localhost:44701/user/jenkins/test-data/85798d88-f13e-4fa9-a7cf-23a440885113/testWithMockedMapReduceSingleRegion/d2f09cdf-cc9a-4bd7-b5ff-1b88c9b3bde5/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/testWithMockedMapReduceSingleRegion=bda65966b80218c7f0d71a096b202532-8434171de0f2428da04172cdc354d943 2023-02-09 05:03:25,472 INFO [StoreOpener-bda65966b80218c7f0d71a096b202532-1] regionserver.HStore(310): Store=bda65966b80218c7f0d71a096b202532/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:25,472 DEBUG [Listener at localhost/41791] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:25,473 INFO [Listener at localhost/41791] regionserver.HRegion(1071): Opened bda65966b80218c7f0d71a096b202532; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62521905, jitterRate=-0.06835101544857025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:25,473 DEBUG [Listener at localhost/41791] regionserver.HRegion(964): Region open journal for bda65966b80218c7f0d71a096b202532: Writing region info on filesystem at 1675919005450Initializing all the Stores at 1675919005450Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919005450Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919005451 (+1 ms)Region opened successfully at 1675919005473 (+22 ms) 2023-02-09 05:03:25,529 DEBUG [Listener at localhost/41791] regionserver.HRegion(1603): Closing bda65966b80218c7f0d71a096b202532, disabling compactions & flushes 2023-02-09 05:03:25,529 INFO [Listener at localhost/41791] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,529 DEBUG [Listener at localhost/41791] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,529 DEBUG [Listener at localhost/41791] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. after waiting 0 ms 2023-02-09 05:03:25,530 DEBUG [Listener at localhost/41791] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,530 INFO [Listener at localhost/41791] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,531 DEBUG [Listener at localhost/41791] regionserver.HRegion(1557): Region close journal for bda65966b80218c7f0d71a096b202532: Waiting for close lock at 1675919005529Disabling compacts and flushes for region at 1675919005529Disabling writes for close at 1675919005530 (+1 ms)Writing region close event to WAL at 1675919005530Closed at 1675919005530 2023-02-09 05:03:25,534 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,534 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-09 05:03:25,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,538 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,539 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,539 INFO [Listener at localhost/41791] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,542 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,542 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,543 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919005543"}]},"ts":"1675919005543"} 2023-02-09 05:03:25,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:25,544 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-09 05:03:25,546 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-09 05:03:25,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, UNASSIGN}] 2023-02-09 05:03:25,548 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, UNASSIGN 2023-02-09 05:03:25,548 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bda65966b80218c7f0d71a096b202532, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,549 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675919005548"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919005548"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919005548"}]},"ts":"1675919005548"} 2023-02-09 05:03:25,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bda65966b80218c7f0d71a096b202532, server=jenkins-hbase4.apache.org,42093,1675919002903}] 2023-02-09 05:03:25,644 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,644 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:25,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bda65966b80218c7f0d71a096b202532, disabling compactions & flushes 2023-02-09 05:03:25,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. after waiting 0 ms 2023-02-09 05:03:25,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:25,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532. 2023-02-09 05:03:25,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bda65966b80218c7f0d71a096b202532: Waiting for close lock at 1675919005702Running coprocessor pre-close hooks at 1675919005702Disabling compacts and flushes for region at 1675919005702Disabling writes for close at 1675919005702Writing region close event to WAL at 1675919005703 (+1 ms)Running coprocessor post-close hooks at 1675919005707 (+4 ms)Closed at 1675919005707 2023-02-09 05:03:25,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,708 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bda65966b80218c7f0d71a096b202532, regionState=CLOSED 2023-02-09 05:03:25,709 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675919005708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919005708"}]},"ts":"1675919005708"} 2023-02-09 05:03:25,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 05:03:25,711 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bda65966b80218c7f0d71a096b202532, server=jenkins-hbase4.apache.org,42093,1675919002903 in 160 msec 2023-02-09 05:03:25,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 05:03:25,713 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bda65966b80218c7f0d71a096b202532, UNASSIGN in 165 msec 2023-02-09 05:03:25,713 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919005713"}]},"ts":"1675919005713"} 2023-02-09 05:03:25,714 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-09 05:03:25,715 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-09 05:03:25,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-09 05:03:25,846 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,846 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:25,847 INFO [Listener at localhost/41791] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-09 05:03:25,847 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,848 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,851 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,851 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:25,854 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,856 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1, FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2, FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/recovered.edits] 2023-02-09 05:03:25,859 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734 to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/archive/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/522dfe488d7741cbb6bfcce0400c7734 2023-02-09 05:03:25,860 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/ce3ff0c89bb046dc934bb700314262a0 to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/archive/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f1/ce3ff0c89bb046dc934bb700314262a0 2023-02-09 05:03:25,862 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943 to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/archive/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/8434171de0f2428da04172cdc354d943 2023-02-09 05:03:25,863 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/88f6f67c261d4292a64eea923d043f5a to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/archive/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/f2/88f6f67c261d4292a64eea923d043f5a 2023-02-09 05:03:25,866 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/recovered.edits/12.seqid to hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/archive/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532/recovered.edits/12.seqid 2023-02-09 05:03:25,867 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/.tmp/data/default/testWithMockedMapReduceSingleRegion/bda65966b80218c7f0d71a096b202532 2023-02-09 05:03:25,867 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-09 05:03:25,869 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,870 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-09 05:03:25,872 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-09 05:03:25,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-09 05:03:25,873 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919005873"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:25,874 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 05:03:25,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bda65966b80218c7f0d71a096b202532, NAME => 'testWithMockedMapReduceSingleRegion,,1675919003972.bda65966b80218c7f0d71a096b202532.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 05:03:25,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-09 05:03:25,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675919005874"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:25,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-09 05:03:25,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-09 05:03:25,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 29 msec 2023-02-09 05:03:25,952 INFO [Listener at localhost/41791] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:25,952 INFO [Listener at localhost/41791] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:25,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33149] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:25,954 INFO [Listener at localhost/41791] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-09 05:03:25,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:25,954 INFO [Listener at localhost/41791] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:25,954 DEBUG [Listener at localhost/41791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bfe9df9 to 127.0.0.1:52839 2023-02-09 05:03:25,954 DEBUG [Listener at localhost/41791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:25,955 DEBUG [Listener at localhost/41791] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:25,955 DEBUG [Listener at localhost/41791] util.JVMClusterUtil(257): Found active master hash=611953881, stopped=false 2023-02-09 05:03:25,955 INFO [Listener at localhost/41791] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:25,957 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:25,957 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:25,957 INFO [Listener at localhost/41791] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:25,957 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:25,957 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:25,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:25,959 DEBUG [Listener at localhost/41791] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37135bb4 to 127.0.0.1:52839 2023-02-09 05:03:25,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:25,959 DEBUG [Listener at localhost/41791] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:25,959 INFO [Listener at localhost/41791] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42093,1675919002903' ***** 2023-02-09 05:03:25,960 INFO [Listener at localhost/41791] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:25,960 INFO [Listener at localhost/41791] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40673,1675919002930' ***** 2023-02-09 05:03:25,960 INFO [Listener at localhost/41791] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:25,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:25,960 INFO [RS:1;jenkins-hbase4:40673] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:25,960 INFO [RS:0;jenkins-hbase4:42093] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:25,960 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:25,960 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:25,960 INFO [RS:1;jenkins-hbase4:40673] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:25,960 INFO [RS:0;jenkins-hbase4:42093] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:25,962 INFO [RS:1;jenkins-hbase4:40673] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:25,962 INFO [RS:0;jenkins-hbase4:42093] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:25,962 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(3304): Received CLOSE for a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:25,962 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:25,962 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:25,962 DEBUG [RS:0;jenkins-hbase4:42093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x688e9daf to 127.0.0.1:52839 2023-02-09 05:03:25,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a9fa9e279aca897a55154a34034b3f0f, disabling compactions & flushes 2023-02-09 05:03:25,963 DEBUG [RS:0;jenkins-hbase4:42093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:25,963 INFO [RS:0;jenkins-hbase4:42093] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:25,963 DEBUG [RS:1;jenkins-hbase4:40673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d2bbf17 to 127.0.0.1:52839 2023-02-09 05:03:25,963 INFO [RS:0;jenkins-hbase4:42093] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:25,963 INFO [RS:0;jenkins-hbase4:42093] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:25,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:25,963 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:25,963 DEBUG [RS:1;jenkins-hbase4:40673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:25,963 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40673,1675919002930; all regions closed. 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. after waiting 0 ms 2023-02-09 05:03:25,963 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:25,963 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a9fa9e279aca897a55154a34034b3f0f=hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f.} 2023-02-09 05:03:25,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:25,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a9fa9e279aca897a55154a34034b3f0f 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:25,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:25,963 DEBUG [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1505): Waiting on 1588230740, a9fa9e279aca897a55154a34034b3f0f 2023-02-09 05:03:25,964 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:25,964 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-09 05:03:25,967 DEBUG [RS:1;jenkins-hbase4:40673] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40673%2C1675919002930:(num 1675919004233) 2023-02-09 05:03:25,968 DEBUG [RS:1;jenkins-hbase4:40673] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:25,968 INFO [RS:1;jenkins-hbase4:40673] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:25,968 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:25,969 INFO [RS:1;jenkins-hbase4:40673] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40673 2023-02-09 05:03:25,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/.tmp/info/96900a4709c041cabde4ec8f506295f7 2023-02-09 05:03:25,976 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/info/b985a91840014ceba4f3b1f27806ce2f 2023-02-09 05:03:25,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b985a91840014ceba4f3b1f27806ce2f 2023-02-09 05:03:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/.tmp/info/96900a4709c041cabde4ec8f506295f7 as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/info/96900a4709c041cabde4ec8f506295f7 2023-02-09 05:03:25,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/info/96900a4709c041cabde4ec8f506295f7, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:25,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a9fa9e279aca897a55154a34034b3f0f in 22ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:25,987 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/rep_barrier/08b0cb0762c64c5197d7b16fead93521 2023-02-09 05:03:25,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/namespace/a9fa9e279aca897a55154a34034b3f0f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:25,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:25,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a9fa9e279aca897a55154a34034b3f0f: Waiting for close lock at 1675919005962Running coprocessor pre-close hooks at 1675919005962Disabling compacts and flushes for region at 1675919005962Disabling writes for close at 1675919005963 (+1 ms)Obtaining lock to block concurrent updates at 1675919005963Preparing flush snapshotting stores in a9fa9e279aca897a55154a34034b3f0f at 1675919005963Finished memstore snapshotting hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675919005964 (+1 ms)Flushing stores of hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. at 1675919005965 (+1 ms)Flushing a9fa9e279aca897a55154a34034b3f0f/info: creating writer at 1675919005965Flushing a9fa9e279aca897a55154a34034b3f0f/info: appending metadata at 1675919005968 (+3 ms)Flushing a9fa9e279aca897a55154a34034b3f0f/info: closing flushed file at 1675919005968Flushing a9fa9e279aca897a55154a34034b3f0f/info: reopening flushed file at 1675919005981 (+13 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a9fa9e279aca897a55154a34034b3f0f in 22ms, sequenceid=6, compaction requested=false at 1675919005985 (+4 ms)Writing region close event to WAL at 1675919005985Running coprocessor post-close hooks at 1675919005988 (+3 ms)Closed at 1675919005988 2023-02-09 05:03:25,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675919003480.a9fa9e279aca897a55154a34034b3f0f. 2023-02-09 05:03:25,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08b0cb0762c64c5197d7b16fead93521 2023-02-09 05:03:25,994 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:25,998 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/table/1cdc1f24afc44028b7795b706563f55d 2023-02-09 05:03:26,001 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cdc1f24afc44028b7795b706563f55d 2023-02-09 05:03:26,002 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/info/b985a91840014ceba4f3b1f27806ce2f as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/info/b985a91840014ceba4f3b1f27806ce2f 2023-02-09 05:03:26,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b985a91840014ceba4f3b1f27806ce2f 2023-02-09 05:03:26,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/info/b985a91840014ceba4f3b1f27806ce2f, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 05:03:26,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/rep_barrier/08b0cb0762c64c5197d7b16fead93521 as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/rep_barrier/08b0cb0762c64c5197d7b16fead93521 2023-02-09 05:03:26,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08b0cb0762c64c5197d7b16fead93521 2023-02-09 05:03:26,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/rep_barrier/08b0cb0762c64c5197d7b16fead93521, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 05:03:26,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/.tmp/table/1cdc1f24afc44028b7795b706563f55d as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/table/1cdc1f24afc44028b7795b706563f55d 2023-02-09 05:03:26,012 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:26,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1cdc1f24afc44028b7795b706563f55d 2023-02-09 05:03:26,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/table/1cdc1f24afc44028b7795b706563f55d, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 05:03:26,030 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=21, compaction requested=false 2023-02-09 05:03:26,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 05:03:26,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:26,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:26,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919005963Running coprocessor pre-close hooks at 1675919005963Disabling compacts and flushes for region at 1675919005963Disabling writes for close at 1675919005964 (+1 ms)Obtaining lock to block concurrent updates at 1675919005964Preparing flush snapshotting stores in 1588230740 at 1675919005964Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675919005964Flushing stores of hbase:meta,,1.1588230740 at 1675919005966 (+2 ms)Flushing 1588230740/info: creating writer at 1675919005966Flushing 1588230740/info: appending metadata at 1675919005968 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675919005968Flushing 1588230740/rep_barrier: creating writer at 1675919005980 (+12 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675919005982 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675919005982Flushing 1588230740/table: creating writer at 1675919005990 (+8 ms)Flushing 1588230740/table: appending metadata at 1675919005992 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675919005992Flushing 1588230740/info: reopening flushed file at 1675919006002 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675919006007 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675919006011 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 66ms, sequenceid=21, compaction requested=false at 1675919006030 (+19 ms)Writing region close event to WAL at 1675919006036 (+6 ms)Running coprocessor post-close hooks at 1675919006039 (+3 ms)Closed at 1675919006039 2023-02-09 05:03:26,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:26,068 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:26,068 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40673,1675919002930 2023-02-09 05:03:26,068 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c9e570a rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,068 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:26,068 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:26,068 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27cb58d rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,068 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:26,069 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40673,1675919002930] 2023-02-09 05:03:26,069 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40673,1675919002930; numProcessing=1 2023-02-09 05:03:26,070 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40673,1675919002930 already deleted, retry=false 2023-02-09 05:03:26,070 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40673,1675919002930 expired; onlineServers=1 2023-02-09 05:03:26,164 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42093,1675919002903; all regions closed. 2023-02-09 05:03:26,167 DEBUG [RS:0;jenkins-hbase4:42093] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs 2023-02-09 05:03:26,167 INFO [RS:0;jenkins-hbase4:42093] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42093%2C1675919002903.meta:.meta(num 1675919003431) 2023-02-09 05:03:26,174 DEBUG [RS:0;jenkins-hbase4:42093] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/oldWALs 2023-02-09 05:03:26,174 INFO [RS:0;jenkins-hbase4:42093] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42093%2C1675919002903:(num 1675919003823) 2023-02-09 05:03:26,174 DEBUG [RS:0;jenkins-hbase4:42093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:26,174 INFO [RS:0;jenkins-hbase4:42093] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:26,174 INFO [RS:0;jenkins-hbase4:42093] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:26,174 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:26,175 INFO [RS:0;jenkins-hbase4:42093] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42093 2023-02-09 05:03:26,176 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42093,1675919002903 2023-02-09 05:03:26,176 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:26,176 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2a597aa9 rejected from java.util.concurrent.ThreadPoolExecutor@2e66fb3a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,178 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42093,1675919002903] 2023-02-09 05:03:26,179 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42093,1675919002903; numProcessing=2 2023-02-09 05:03:26,179 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42093,1675919002903 already deleted, retry=false 2023-02-09 05:03:26,179 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42093,1675919002903 expired; onlineServers=0 2023-02-09 05:03:26,180 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33149,1675919002855' ***** 2023-02-09 05:03:26,180 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:26,180 DEBUG [M:0;jenkins-hbase4:33149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20462c8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:26,180 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33149,1675919002855 2023-02-09 05:03:26,180 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33149,1675919002855; all regions closed. 2023-02-09 05:03:26,180 DEBUG [M:0;jenkins-hbase4:33149] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:26,180 DEBUG [M:0;jenkins-hbase4:33149] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:26,181 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:26,181 DEBUG [M:0;jenkins-hbase4:33149] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:26,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919003080] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919003080,5,FailOnTimeoutGroup] 2023-02-09 05:03:26,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919003080] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919003080,5,FailOnTimeoutGroup] 2023-02-09 05:03:26,181 INFO [M:0;jenkins-hbase4:33149] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:26,182 INFO [M:0;jenkins-hbase4:33149] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:26,182 INFO [M:0;jenkins-hbase4:33149] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:26,182 DEBUG [M:0;jenkins-hbase4:33149] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:26,182 INFO [M:0;jenkins-hbase4:33149] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:26,183 ERROR [M:0;jenkins-hbase4:33149] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:26,183 INFO [M:0;jenkins-hbase4:33149] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:26,183 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:26,183 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:26,183 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:26,183 DEBUG [M:0;jenkins-hbase4:33149] zookeeper.ZKUtil(398): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:26,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:26,183 WARN [M:0;jenkins-hbase4:33149] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:26,183 INFO [M:0;jenkins-hbase4:33149] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:26,184 INFO [M:0;jenkins-hbase4:33149] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:26,184 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:26,184 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:26,184 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:26,184 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:26,184 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:26,184 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.14 KB heapSize=67.06 KB 2023-02-09 05:03:26,193 INFO [M:0;jenkins-hbase4:33149] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.14 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8e785fafb313406ea1c3daf6bcf28eba 2023-02-09 05:03:26,197 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8e785fafb313406ea1c3daf6bcf28eba as hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8e785fafb313406ea1c3daf6bcf28eba 2023-02-09 05:03:26,201 INFO [M:0;jenkins-hbase4:33149] regionserver.HStore(1080): Added hdfs://localhost:44701/user/jenkins/test-data/2de6ec2b-170d-86a9-d644-3d0e1e2b7356/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8e785fafb313406ea1c3daf6bcf28eba, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 05:03:26,202 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegion(2947): Finished flush of dataSize ~56.14 KB/57486, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-09 05:03:26,207 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:26,207 DEBUG [M:0;jenkins-hbase4:33149] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919006184Disabling compacts and flushes for region at 1675919006184Disabling writes for close at 1675919006184Obtaining lock to block concurrent updates at 1675919006184Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675919006184Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57486, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1675919006184Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675919006185 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675919006186 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675919006188 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675919006188Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675919006198 (+10 ms)Finished flush of dataSize ~56.14 KB/57486, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1675919006202 (+4 ms)Writing region close event to WAL at 1675919006207 (+5 ms)Closed at 1675919006207 2023-02-09 05:03:26,210 INFO [M:0;jenkins-hbase4:33149] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:26,210 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:26,211 INFO [M:0;jenkins-hbase4:33149] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33149 2023-02-09 05:03:26,213 DEBUG [M:0;jenkins-hbase4:33149] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33149,1675919002855 already deleted, retry=false 2023-02-09 05:03:26,359 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,359 INFO [M:0;jenkins-hbase4:33149] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33149,1675919002855; zookeeper connection closed. 2023-02-09 05:03:26,359 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ab09cd8 rejected from java.util.concurrent.ThreadPoolExecutor@3e8f0f56[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,360 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): master:33149-0x1003776769c0000, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,360 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74548be0 rejected from java.util.concurrent.ThreadPoolExecutor@3e8f0f56[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,459 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,459 INFO [RS:0;jenkins-hbase4:42093] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42093,1675919002903; zookeeper connection closed. 2023-02-09 05:03:26,459 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b28a174 rejected from java.util.concurrent.ThreadPoolExecutor@2e66fb3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,459 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:42093-0x1003776769c0001, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,459 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43e397d3 rejected from java.util.concurrent.ThreadPoolExecutor@2e66fb3a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,461 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@78004037] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@78004037 2023-02-09 05:03:26,559 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,559 INFO [RS:1;jenkins-hbase4:40673] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40673,1675919002930; zookeeper connection closed. 2023-02-09 05:03:26,559 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ad122c0 rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,559 DEBUG [Listener at localhost/41791-EventThread] zookeeper.ZKWatcher(600): regionserver:40673-0x1003776769c0002, quorum=127.0.0.1:52839, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:26,559 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4dd032b7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4dd032b7 2023-02-09 05:03:26,559 ERROR [Listener at localhost/41791-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@abbb29f rejected from java.util.concurrent.ThreadPoolExecutor@48a1da41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:26,560 INFO [Listener at localhost/41791] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:26,561 WARN [Listener at localhost/41791] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:26,564 INFO [Listener at localhost/41791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:26,669 WARN [BP-735184050-172.31.14.131-1675919002207 heartbeating to localhost/127.0.0.1:44701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:26,670 WARN [BP-735184050-172.31.14.131-1675919002207 heartbeating to localhost/127.0.0.1:44701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735184050-172.31.14.131-1675919002207 (Datanode Uuid 65c3f798-19a5-4a89-b5ac-1460b9b7bf7b) service to localhost/127.0.0.1:44701 2023-02-09 05:03:26,670 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/dfs/data/data3/current/BP-735184050-172.31.14.131-1675919002207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:26,671 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/dfs/data/data4/current/BP-735184050-172.31.14.131-1675919002207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:26,672 WARN [Listener at localhost/41791] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:26,676 INFO [Listener at localhost/41791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:26,781 WARN [BP-735184050-172.31.14.131-1675919002207 heartbeating to localhost/127.0.0.1:44701] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:26,781 WARN [BP-735184050-172.31.14.131-1675919002207 heartbeating to localhost/127.0.0.1:44701] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-735184050-172.31.14.131-1675919002207 (Datanode Uuid 0a561464-e094-4ae0-8910-8f072b386d6b) service to localhost/127.0.0.1:44701 2023-02-09 05:03:26,781 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/dfs/data/data1/current/BP-735184050-172.31.14.131-1675919002207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:26,782 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/cluster_f7d9feae-7747-bd0d-4700-41efd18df0cf/dfs/data/data2/current/BP-735184050-172.31.14.131-1675919002207] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:26,792 INFO [Listener at localhost/41791] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:26,905 INFO [Listener at localhost/41791] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:26,919 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:26,931 INFO [Listener at localhost/41791] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33149,1675919002855)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44701 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins@localhost:44701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41791 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:44701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:44701 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/41791.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44701 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:44701 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=665 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 257), ProcessCount=167 (was 167), AvailableMemoryMB=3703 (was 3725) 2023-02-09 05:03:26,942 INFO [Listener at localhost/41791] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=665, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=167, AvailableMemoryMB=3703 2023-02-09 05:03:26,952 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.log.dir so I do NOT create it in target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247 2023-02-09 05:03:26,952 WARN [Listener at localhost/41791] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:26,952 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.tmp.dir so I do NOT create it in target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247 2023-02-09 05:03:26,953 WARN [Listener at localhost/41791] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/293d7179-a543-54fa-4089-a0a86dc47d9a/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:26,953 DEBUG [Listener at localhost/41791] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2, deleteOnExit=true 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/test.cache.data in system properties and HBase conf 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:26,953 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:26,954 DEBUG [Listener at localhost/41791] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:26,954 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:26,955 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:26,955 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:26,955 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:26,955 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:26,955 INFO [Listener at localhost/41791] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:26,959 WARN [Listener at localhost/41791] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:26,959 WARN [Listener at localhost/41791] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:26,999 WARN [Listener at localhost/41791] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:27,001 INFO [Listener at localhost/41791] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:27,007 INFO [Listener at localhost/41791] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/java.io.tmpdir/Jetty_localhost_35071_hdfs____7fsr2q/webapp 2023-02-09 05:03:27,099 INFO [Listener at localhost/41791] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35071 2023-02-09 05:03:27,104 WARN [Listener at localhost/41791] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:27,104 WARN [Listener at localhost/41791] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:27,145 WARN [Listener at localhost/33961] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:27,163 WARN [Listener at localhost/33961] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:27,167 WARN [Listener at localhost/33961] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:27,168 INFO [Listener at localhost/33961] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:27,177 INFO [Listener at localhost/33961] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/java.io.tmpdir/Jetty_localhost_46639_datanode____.rpn8ov/webapp 2023-02-09 05:03:27,286 INFO [Listener at localhost/33961] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46639 2023-02-09 05:03:27,294 WARN [Listener at localhost/39855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:27,312 WARN [Listener at localhost/39855] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:27,314 WARN [Listener at localhost/39855] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:27,315 INFO [Listener at localhost/39855] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:27,320 INFO [Listener at localhost/39855] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/java.io.tmpdir/Jetty_localhost_36483_datanode____tev3kj/webapp 2023-02-09 05:03:27,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x450558a343af73cd: Processing first storage report for DS-64cd479f-d184-422d-acf0-c24e4ed25da3 from datanode 9d4449f6-bf8d-4d10-a8f3-4fba039e039b 2023-02-09 05:03:27,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x450558a343af73cd: from storage DS-64cd479f-d184-422d-acf0-c24e4ed25da3 node DatanodeRegistration(127.0.0.1:37607, datanodeUuid=9d4449f6-bf8d-4d10-a8f3-4fba039e039b, infoPort=39979, infoSecurePort=0, ipcPort=39855, storageInfo=lv=-57;cid=testClusterID;nsid=616944173;c=1675919006961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:27,395 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x450558a343af73cd: Processing first storage report for DS-969546af-dc43-4caf-8346-a8230909539c from datanode 9d4449f6-bf8d-4d10-a8f3-4fba039e039b 2023-02-09 05:03:27,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x450558a343af73cd: from storage DS-969546af-dc43-4caf-8346-a8230909539c node DatanodeRegistration(127.0.0.1:37607, datanodeUuid=9d4449f6-bf8d-4d10-a8f3-4fba039e039b, infoPort=39979, infoSecurePort=0, ipcPort=39855, storageInfo=lv=-57;cid=testClusterID;nsid=616944173;c=1675919006961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:27,432 INFO [Listener at localhost/39855] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36483 2023-02-09 05:03:27,439 WARN [Listener at localhost/46243] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb2902492cb552a3: Processing first storage report for DS-eb8ee50f-80da-4bf4-a4ea-331094783070 from datanode a007c79e-90bb-4f05-a365-201f571b95ec 2023-02-09 05:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb2902492cb552a3: from storage DS-eb8ee50f-80da-4bf4-a4ea-331094783070 node DatanodeRegistration(127.0.0.1:43707, datanodeUuid=a007c79e-90bb-4f05-a365-201f571b95ec, infoPort=35855, infoSecurePort=0, ipcPort=46243, storageInfo=lv=-57;cid=testClusterID;nsid=616944173;c=1675919006961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb2902492cb552a3: Processing first storage report for DS-d1ccd4b1-9aac-493f-9bc0-cd2b67362ebc from datanode a007c79e-90bb-4f05-a365-201f571b95ec 2023-02-09 05:03:27,532 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb2902492cb552a3: from storage DS-d1ccd4b1-9aac-493f-9bc0-cd2b67362ebc node DatanodeRegistration(127.0.0.1:43707, datanodeUuid=a007c79e-90bb-4f05-a365-201f571b95ec, infoPort=35855, infoSecurePort=0, ipcPort=46243, storageInfo=lv=-57;cid=testClusterID;nsid=616944173;c=1675919006961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:27,551 DEBUG [Listener at localhost/46243] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247 2023-02-09 05:03:27,554 INFO [Listener at localhost/46243] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/zookeeper_0, clientPort=53263, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:27,555 INFO [Listener at localhost/46243] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53263 2023-02-09 05:03:27,555 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,556 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,576 INFO [Listener at localhost/46243] util.FSUtils(479): Created version file at hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9 with version=8 2023-02-09 05:03:27,577 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,578 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,579 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33961/user/jenkins/test-data/728d1780-e3db-cc18-50d3-8da2eccae987/hbase-staging 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,581 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:27,582 INFO [Listener at localhost/46243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:27,584 INFO [Listener at localhost/46243] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39215 2023-02-09 05:03:27,584 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,586 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,587 INFO [Listener at localhost/46243] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39215 connecting to ZooKeeper ensemble=127.0.0.1:53263 2023-02-09 05:03:27,600 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:392150x0, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:27,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39215-0x100377689060000 connected 2023-02-09 05:03:27,622 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:27,622 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:27,623 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:27,624 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-09 05:03:27,626 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39215 2023-02-09 05:03:27,627 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39215 2023-02-09 05:03:27,628 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-09 05:03:27,628 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39215 2023-02-09 05:03:27,628 INFO [Listener at localhost/46243] master.HMaster(439): hbase.rootdir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9, hbase.cluster.distributed=false 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,647 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:27,648 INFO [Listener at localhost/46243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:27,648 INFO [Listener at localhost/46243] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34455 2023-02-09 05:03:27,649 INFO [Listener at localhost/46243] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:27,653 DEBUG [Listener at localhost/46243] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:27,654 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,655 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,657 INFO [Listener at localhost/46243] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34455 connecting to ZooKeeper ensemble=127.0.0.1:53263 2023-02-09 05:03:27,662 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:344550x0, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:27,663 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:344550x0, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:27,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34455-0x100377689060001 connected 2023-02-09 05:03:27,663 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:27,664 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:27,667 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34455 2023-02-09 05:03:27,667 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34455 2023-02-09 05:03:27,672 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34455 2023-02-09 05:03:27,672 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34455 2023-02-09 05:03:27,672 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34455 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:27,689 INFO [Listener at localhost/46243] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:27,690 INFO [Listener at localhost/46243] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46401 2023-02-09 05:03:27,691 INFO [Listener at localhost/46243] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:27,691 DEBUG [Listener at localhost/46243] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:27,692 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,693 INFO [Listener at localhost/46243] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,694 INFO [Listener at localhost/46243] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46401 connecting to ZooKeeper ensemble=127.0.0.1:53263 2023-02-09 05:03:27,697 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:464010x0, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:27,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46401-0x100377689060002 connected 2023-02-09 05:03:27,698 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:27,699 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:27,699 DEBUG [Listener at localhost/46243] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:27,704 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46401 2023-02-09 05:03:27,704 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46401 2023-02-09 05:03:27,704 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46401 2023-02-09 05:03:27,707 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46401 2023-02-09 05:03:27,708 DEBUG [Listener at localhost/46243] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46401 2023-02-09 05:03:27,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,712 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:27,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,714 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:27,714 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:27,714 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:27,715 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:27,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39215,1675919007580 from backup master directory 2023-02-09 05:03:27,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:27,718 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,718 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:27,719 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:27,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/hbase.id with ID: 566a5b5c-6a07-4838-9b36-28e9fc6c8c15 2023-02-09 05:03:27,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:27,743 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x75225a37 to 127.0.0.1:53263 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:27,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f796039, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:27,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:27,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:27,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:27,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store-tmp 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:27,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:27,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919007770Disabling compacts and flushes for region at 1675919007770Disabling writes for close at 1675919007770Writing region close event to WAL at 1675919007770Closed at 1675919007770 2023-02-09 05:03:27,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/WALs/jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39215%2C1675919007580, suffix=, logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/WALs/jenkins-hbase4.apache.org,39215,1675919007580, archiveDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:27,785 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK] 2023-02-09 05:03:27,785 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK] 2023-02-09 05:03:27,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/WALs/jenkins-hbase4.apache.org,39215,1675919007580/jenkins-hbase4.apache.org%2C39215%2C1675919007580.1675919007773 2023-02-09 05:03:27,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK], DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK]] 2023-02-09 05:03:27,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,790 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,791 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:27,791 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:27,791 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:27,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:27,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64193259, jitterRate=-0.043445900082588196}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:27,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675919007789Initializing all the Stores at 1675919007789Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919007789Cleaning up temporary data from old regions at 1675919007793 (+4 ms)Cleaning up detritus from prior splits at 1675919007793Region opened successfully at 1675919007797 (+4 ms) 2023-02-09 05:03:27,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:27,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:27,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:27,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:27,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:27,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:27,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:27,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:27,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:27,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:27,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:27,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:27,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:27,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:27,822 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:27,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:27,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:27,825 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:27,825 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:27,825 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39215,1675919007580, sessionid=0x100377689060000, setting cluster-up flag (Was=false) 2023-02-09 05:03:27,829 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:27,831 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:27,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,841 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:27,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:27,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:27,845 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/.tmp 2023-02-09 05:03:27,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:27,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919037849 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:27,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:27,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,852 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:27,852 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:27,853 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:27,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:27,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:27,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:27,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919007862,5,FailOnTimeoutGroup] 2023-02-09 05:03:27,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919007862,5,FailOnTimeoutGroup] 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,870 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:27,871 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:27,871 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9 2023-02-09 05:03:27,882 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:27,883 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:27,884 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/info 2023-02-09 05:03:27,885 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:27,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:27,885 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:27,886 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:27,887 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:27,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:27,887 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:27,888 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/table 2023-02-09 05:03:27,888 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:27,889 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:27,890 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740 2023-02-09 05:03:27,890 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740 2023-02-09 05:03:27,892 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:27,893 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:27,896 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:27,897 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59506647, jitterRate=-0.11328186094760895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:27,897 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675919007882Initializing all the Stores at 1675919007883 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919007883Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919007883Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919007883Cleaning up temporary data from old regions at 1675919007891 (+8 ms)Cleaning up detritus from prior splits at 1675919007891Region opened successfully at 1675919007897 (+6 ms) 2023-02-09 05:03:27,897 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:27,897 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:27,897 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:27,897 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:27,897 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:27,900 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:27,900 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919007897Disabling compacts and flushes for region at 1675919007897Disabling writes for close at 1675919007897Writing region close event to WAL at 1675919007900 (+3 ms)Closed at 1675919007900 2023-02-09 05:03:27,901 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:27,901 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:27,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:27,902 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:27,904 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:27,911 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(952): ClusterId : 566a5b5c-6a07-4838-9b36-28e9fc6c8c15 2023-02-09 05:03:27,911 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(952): ClusterId : 566a5b5c-6a07-4838-9b36-28e9fc6c8c15 2023-02-09 05:03:27,911 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:27,911 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:27,914 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:27,914 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:27,914 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:27,914 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:27,916 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:27,916 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:27,917 DEBUG [RS:1;jenkins-hbase4:46401] zookeeper.ReadOnlyZKClient(139): Connect 0x178f44c3 to 127.0.0.1:53263 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:27,917 DEBUG [RS:0;jenkins-hbase4:34455] zookeeper.ReadOnlyZKClient(139): Connect 0x1d7c70c9 to 127.0.0.1:53263 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:27,920 DEBUG [RS:1;jenkins-hbase4:46401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1948b842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:27,920 DEBUG [RS:1;jenkins-hbase4:46401] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d772fb3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:27,920 DEBUG [RS:0;jenkins-hbase4:34455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13bb9d16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:27,920 DEBUG [RS:0;jenkins-hbase4:34455] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17841bb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:27,933 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46401 2023-02-09 05:03:27,933 INFO [RS:1;jenkins-hbase4:46401] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:27,933 INFO [RS:1;jenkins-hbase4:46401] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:27,933 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:27,934 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39215,1675919007580 with isa=jenkins-hbase4.apache.org/172.31.14.131:46401, startcode=1675919007688 2023-02-09 05:03:27,934 DEBUG [RS:1;jenkins-hbase4:46401] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:27,934 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34455 2023-02-09 05:03:27,934 INFO [RS:0;jenkins-hbase4:34455] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:27,934 INFO [RS:0;jenkins-hbase4:34455] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:27,934 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:27,935 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39215,1675919007580 with isa=jenkins-hbase4.apache.org/172.31.14.131:34455, startcode=1675919007646 2023-02-09 05:03:27,935 DEBUG [RS:0;jenkins-hbase4:34455] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:27,936 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59739, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:27,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,938 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9 2023-02-09 05:03:27,938 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34153, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:27,938 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33961 2023-02-09 05:03:27,938 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:27,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,939 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9 2023-02-09 05:03:27,939 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33961 2023-02-09 05:03:27,939 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:27,941 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:27,945 DEBUG [RS:1;jenkins-hbase4:46401] zookeeper.ZKUtil(162): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,945 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34455,1675919007646] 2023-02-09 05:03:27,945 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46401,1675919007688] 2023-02-09 05:03:27,945 DEBUG [RS:0;jenkins-hbase4:34455] zookeeper.ZKUtil(162): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,945 WARN [RS:1;jenkins-hbase4:46401] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:27,945 WARN [RS:0;jenkins-hbase4:34455] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:27,945 INFO [RS:1;jenkins-hbase4:46401] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:27,945 INFO [RS:0;jenkins-hbase4:34455] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:27,945 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,945 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,950 DEBUG [RS:0;jenkins-hbase4:34455] zookeeper.ZKUtil(162): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,950 DEBUG [RS:1;jenkins-hbase4:46401] zookeeper.ZKUtil(162): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,950 DEBUG [RS:0;jenkins-hbase4:34455] zookeeper.ZKUtil(162): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,950 DEBUG [RS:1;jenkins-hbase4:46401] zookeeper.ZKUtil(162): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,951 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:27,951 DEBUG [RS:0;jenkins-hbase4:34455] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:27,951 INFO [RS:1;jenkins-hbase4:46401] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:27,951 INFO [RS:0;jenkins-hbase4:34455] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:27,953 INFO [RS:1;jenkins-hbase4:46401] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:27,953 INFO [RS:1;jenkins-hbase4:46401] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:27,953 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,953 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:27,954 INFO [RS:0;jenkins-hbase4:34455] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:27,955 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,955 INFO [RS:0;jenkins-hbase4:34455] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:27,955 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,955 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,956 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,956 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,956 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:27,956 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,957 DEBUG [RS:1;jenkins-hbase4:46401] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,961 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,961 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,961 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,961 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,962 DEBUG [RS:0;jenkins-hbase4:34455] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:27,964 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,965 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,965 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,975 INFO [RS:1;jenkins-hbase4:46401] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:27,976 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46401,1675919007688-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,985 INFO [RS:0;jenkins-hbase4:34455] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:27,985 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34455,1675919007646-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:27,988 INFO [RS:1;jenkins-hbase4:46401] regionserver.Replication(203): jenkins-hbase4.apache.org,46401,1675919007688 started 2023-02-09 05:03:27,988 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46401,1675919007688, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46401, sessionid=0x100377689060002 2023-02-09 05:03:27,988 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:27,988 DEBUG [RS:1;jenkins-hbase4:46401] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,988 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46401,1675919007688' 2023-02-09 05:03:27,988 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:27,988 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46401,1675919007688' 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:27,989 DEBUG [RS:1;jenkins-hbase4:46401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:27,990 DEBUG [RS:1;jenkins-hbase4:46401] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:27,990 INFO [RS:1;jenkins-hbase4:46401] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:27,990 INFO [RS:1;jenkins-hbase4:46401] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:27,997 INFO [RS:0;jenkins-hbase4:34455] regionserver.Replication(203): jenkins-hbase4.apache.org,34455,1675919007646 started 2023-02-09 05:03:27,997 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34455,1675919007646, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34455, sessionid=0x100377689060001 2023-02-09 05:03:27,997 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:27,997 DEBUG [RS:0;jenkins-hbase4:34455] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,997 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34455,1675919007646' 2023-02-09 05:03:27,997 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:27,997 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34455,1675919007646' 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:27,998 DEBUG [RS:0;jenkins-hbase4:34455] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:27,998 INFO [RS:0;jenkins-hbase4:34455] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:27,998 INFO [RS:0;jenkins-hbase4:34455] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:28,054 DEBUG [jenkins-hbase4:39215] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:28,054 DEBUG [jenkins-hbase4:39215] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:28,055 DEBUG [jenkins-hbase4:39215] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:28,056 DEBUG [jenkins-hbase4:39215] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:28,056 DEBUG [jenkins-hbase4:39215] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:28,056 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46401,1675919007688, state=OPENING 2023-02-09 05:03:28,057 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:28,058 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:28,059 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:28,059 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46401,1675919007688}] 2023-02-09 05:03:28,214 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:28,214 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:28,215 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:28,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:28,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:28,221 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46401%2C1675919007688.meta, suffix=.meta, logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,46401,1675919007688, archiveDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs, maxLogs=32 2023-02-09 05:03:28,235 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK] 2023-02-09 05:03:28,235 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK] 2023-02-09 05:03:28,240 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,46401,1675919007688/jenkins-hbase4.apache.org%2C46401%2C1675919007688.meta.1675919008221.meta 2023-02-09 05:03:28,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK], DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK]] 2023-02-09 05:03:28,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:28,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:28,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:28,241 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:28,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:28,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:28,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:28,241 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:28,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:28,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/info 2023-02-09 05:03:28,243 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/info 2023-02-09 05:03:28,244 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:28,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:28,244 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:28,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:28,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:28,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:28,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:28,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:28,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/table 2023-02-09 05:03:28,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/table 2023-02-09 05:03:28,247 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:28,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:28,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740 2023-02-09 05:03:28,248 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740 2023-02-09 05:03:28,250 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:28,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:28,252 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74704755, jitterRate=0.11318759620189667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:28,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675919008241Writing region info on filesystem at 1675919008241Initializing all the Stores at 1675919008242 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919008242Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919008242Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919008242Cleaning up temporary data from old regions at 1675919008249 (+7 ms)Cleaning up detritus from prior splits at 1675919008250 (+1 ms)Running coprocessor post-open hooks at 1675919008252 (+2 ms)Region opened successfully at 1675919008252 2023-02-09 05:03:28,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675919008214 2023-02-09 05:03:28,259 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:28,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:28,260 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46401,1675919007688, state=OPEN 2023-02-09 05:03:28,261 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:28,261 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:28,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:28,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46401,1675919007688 in 202 msec 2023-02-09 05:03:28,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:28,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-09 05:03:28,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 418 msec 2023-02-09 05:03:28,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675919007712, completionTime=-1 2023-02-09 05:03:28,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:28,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:28,266 DEBUG [hconnection-0x51d7d57e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:28,267 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46708, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:28,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:28,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919068269 2023-02-09 05:03:28,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919128269 2023-02-09 05:03:28,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 3 msec 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1675919007580-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1675919007580-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1675919007580-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39215, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:28,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:28,284 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:28,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:28,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:28,286 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:28,287 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,287 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8 empty. 2023-02-09 05:03:28,288 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,288 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:28,296 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:28,297 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8aa368534c8f20e0be7dd817e6cfc0c8, NAME => 'hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 8aa368534c8f20e0be7dd817e6cfc0c8, disabling compactions & flushes 2023-02-09 05:03:28,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. after waiting 0 ms 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 8aa368534c8f20e0be7dd817e6cfc0c8: Waiting for close lock at 1675919008305Disabling compacts and flushes for region at 1675919008305Disabling writes for close at 1675919008305Writing region close event to WAL at 1675919008305Closed at 1675919008305 2023-02-09 05:03:28,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:28,308 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919008308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919008308"}]},"ts":"1675919008308"} 2023-02-09 05:03:28,309 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:28,310 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:28,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919008310"}]},"ts":"1675919008310"} 2023-02-09 05:03:28,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:28,314 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:28,314 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:28,314 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:28,314 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:28,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8aa368534c8f20e0be7dd817e6cfc0c8, ASSIGN}] 2023-02-09 05:03:28,317 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8aa368534c8f20e0be7dd817e6cfc0c8, ASSIGN 2023-02-09 05:03:28,317 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8aa368534c8f20e0be7dd817e6cfc0c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46401,1675919007688; forceNewPlan=false, retain=false 2023-02-09 05:03:28,468 INFO [jenkins-hbase4:39215] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:28,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8aa368534c8f20e0be7dd817e6cfc0c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:28,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919008468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919008468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919008468"}]},"ts":"1675919008468"} 2023-02-09 05:03:28,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8aa368534c8f20e0be7dd817e6cfc0c8, server=jenkins-hbase4.apache.org,46401,1675919007688}] 2023-02-09 05:03:28,625 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46401%2C1675919007688, suffix=, logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,46401,1675919007688, archiveDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs, maxLogs=32 2023-02-09 05:03:28,642 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK] 2023-02-09 05:03:28,642 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK] 2023-02-09 05:03:28,644 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,46401,1675919007688/jenkins-hbase4.apache.org%2C46401%2C1675919007688.1675919008627 2023-02-09 05:03:28,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK], DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK]] 2023-02-09 05:03:28,644 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8aa368534c8f20e0be7dd817e6cfc0c8, NAME => 'hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:28,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:28,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,646 INFO [StoreOpener-8aa368534c8f20e0be7dd817e6cfc0c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,647 DEBUG [StoreOpener-8aa368534c8f20e0be7dd817e6cfc0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/info 2023-02-09 05:03:28,647 DEBUG [StoreOpener-8aa368534c8f20e0be7dd817e6cfc0c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/info 2023-02-09 05:03:28,647 INFO [StoreOpener-8aa368534c8f20e0be7dd817e6cfc0c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8aa368534c8f20e0be7dd817e6cfc0c8 columnFamilyName info 2023-02-09 05:03:28,648 INFO [StoreOpener-8aa368534c8f20e0be7dd817e6cfc0c8-1] regionserver.HStore(310): Store=8aa368534c8f20e0be7dd817e6cfc0c8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:28,648 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,649 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,650 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:28,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:28,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8aa368534c8f20e0be7dd817e6cfc0c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71748573, jitterRate=0.06913705170154572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:28,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8aa368534c8f20e0be7dd817e6cfc0c8: Running coprocessor pre-open hook at 1675919008645Writing region info on filesystem at 1675919008645Initializing all the Stores at 1675919008646 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919008646Cleaning up temporary data from old regions at 1675919008649 (+3 ms)Cleaning up detritus from prior splits at 1675919008649Running coprocessor post-open hooks at 1675919008653 (+4 ms)Region opened successfully at 1675919008653 2023-02-09 05:03:28,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8., pid=6, masterSystemTime=1675919008622 2023-02-09 05:03:28,657 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,657 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:28,657 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8aa368534c8f20e0be7dd817e6cfc0c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:28,657 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919008657"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919008657"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919008657"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919008657"}]},"ts":"1675919008657"} 2023-02-09 05:03:28,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:28,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8aa368534c8f20e0be7dd817e6cfc0c8, server=jenkins-hbase4.apache.org,46401,1675919007688 in 188 msec 2023-02-09 05:03:28,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:28,661 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8aa368534c8f20e0be7dd817e6cfc0c8, ASSIGN in 346 msec 2023-02-09 05:03:28,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:28,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919008662"}]},"ts":"1675919008662"} 2023-02-09 05:03:28,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:28,673 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:28,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 393 msec 2023-02-09 05:03:28,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:28,686 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:28,686 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:28,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:28,695 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:28,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-09 05:03:28,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:28,707 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:28,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-09 05:03:28,713 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:28,716 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:28,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.997sec 2023-02-09 05:03:28,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:28,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:28,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:28,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1675919007580-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:28,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39215,1675919007580-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:28,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:28,811 DEBUG [Listener at localhost/46243] zookeeper.ReadOnlyZKClient(139): Connect 0x783129a6 to 127.0.0.1:53263 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:28,814 DEBUG [Listener at localhost/46243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63d11bc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:28,816 DEBUG [hconnection-0x5fc7cbe8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:28,817 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:28,818 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:28,819 DEBUG [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:28,819 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:28,819 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:28,821 DEBUG [Listener at localhost/46243] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:28,829 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:28,830 INFO [Listener at localhost/46243] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:28,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:28,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:28,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 104 connection: 172.31.14.131:39308 deadline: 1675919068830, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:28,832 INFO [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 05:03:28,832 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:28,832 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:28,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:28,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:28,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:28,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-09 05:03:28,837 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:28,837 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:28,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:28,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:28,838 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:28,839 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a empty. 2023-02-09 05:03:28,839 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:28,839 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 05:03:28,848 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:28,849 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => f735cb964d913a22df58df09892e479a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing f735cb964d913a22df58df09892e479a, disabling compactions & flushes 2023-02-09 05:03:28,856 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. after waiting 0 ms 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:28,856 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:28,856 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for f735cb964d913a22df58df09892e479a: Waiting for close lock at 1675919008856Disabling compacts and flushes for region at 1675919008856Disabling writes for close at 1675919008856Writing region close event to WAL at 1675919008856Closed at 1675919008856 2023-02-09 05:03:28,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:28,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675919008859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919008859"}]},"ts":"1675919008859"} 2023-02-09 05:03:28,860 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:28,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:28,861 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919008861"}]},"ts":"1675919008861"} 2023-02-09 05:03:28,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-09 05:03:28,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:28,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:28,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:28,867 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:28,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, ASSIGN}] 2023-02-09 05:03:28,869 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, ASSIGN 2023-02-09 05:03:28,870 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34455,1675919007646; forceNewPlan=false, retain=false 2023-02-09 05:03:28,938 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:28,938 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:28,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:28,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:29,001 INFO [RS:0;jenkins-hbase4:34455] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34455%2C1675919007646, suffix=, logDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,34455,1675919007646, archiveDir=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs, maxLogs=32 2023-02-09 05:03:29,020 INFO [jenkins-hbase4:39215] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:29,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f735cb964d913a22df58df09892e479a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,021 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675919009020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919009020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919009020"}]},"ts":"1675919009020"} 2023-02-09 05:03:29,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure f735cb964d913a22df58df09892e479a, server=jenkins-hbase4.apache.org,34455,1675919007646}] 2023-02-09 05:03:29,028 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK] 2023-02-09 05:03:29,030 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK] 2023-02-09 05:03:29,036 INFO [RS:0;jenkins-hbase4:34455] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/WALs/jenkins-hbase4.apache.org,34455,1675919007646/jenkins-hbase4.apache.org%2C34455%2C1675919007646.1675919009001 2023-02-09 05:03:29,038 DEBUG [RS:0;jenkins-hbase4:34455] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37607,DS-64cd479f-d184-422d-acf0-c24e4ed25da3,DISK], DatanodeInfoWithStorage[127.0.0.1:43707,DS-eb8ee50f-80da-4bf4-a4ea-331094783070,DISK]] 2023-02-09 05:03:29,139 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,139 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:29,176 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,177 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:29,179 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33320, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:29,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f735cb964d913a22df58df09892e479a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:29,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:29,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,183 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,184 DEBUG [StoreOpener-f735cb964d913a22df58df09892e479a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1 2023-02-09 05:03:29,184 DEBUG [StoreOpener-f735cb964d913a22df58df09892e479a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1 2023-02-09 05:03:29,185 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f735cb964d913a22df58df09892e479a columnFamilyName f1 2023-02-09 05:03:29,185 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] regionserver.HStore(310): Store=f735cb964d913a22df58df09892e479a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:29,185 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,186 DEBUG [StoreOpener-f735cb964d913a22df58df09892e479a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2 2023-02-09 05:03:29,186 DEBUG [StoreOpener-f735cb964d913a22df58df09892e479a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2 2023-02-09 05:03:29,187 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f735cb964d913a22df58df09892e479a columnFamilyName f2 2023-02-09 05:03:29,187 INFO [StoreOpener-f735cb964d913a22df58df09892e479a-1] regionserver.HStore(310): Store=f735cb964d913a22df58df09892e479a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:29,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:29,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f735cb964d913a22df58df09892e479a 2023-02-09 05:03:29,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:29,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f735cb964d913a22df58df09892e479a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75016959, jitterRate=0.11783979833126068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f735cb964d913a22df58df09892e479a: Running coprocessor pre-open hook at 1675919009182Writing region info on filesystem at 1675919009182Initializing all the Stores at 1675919009183 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919009183Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919009183Cleaning up temporary data from old regions at 1675919009189 (+6 ms)Cleaning up detritus from prior splits at 1675919009189Running coprocessor post-open hooks at 1675919009193 (+4 ms)Region opened successfully at 1675919009193 2023-02-09 05:03:29,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a., pid=12, masterSystemTime=1675919009176 2023-02-09 05:03:29,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,198 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f735cb964d913a22df58df09892e479a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,198 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675919009198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919009198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919009198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919009198"}]},"ts":"1675919009198"} 2023-02-09 05:03:29,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 05:03:29,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure f735cb964d913a22df58df09892e479a, server=jenkins-hbase4.apache.org,34455,1675919007646 in 177 msec 2023-02-09 05:03:29,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 05:03:29,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, ASSIGN in 334 msec 2023-02-09 05:03:29,203 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:29,203 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919009203"}]},"ts":"1675919009203"} 2023-02-09 05:03:29,205 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-09 05:03:29,207 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:29,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 373 msec 2023-02-09 05:03:29,441 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,441 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:29,443 INFO [Listener at localhost/46243] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-09 05:03:29,443 DEBUG [Listener at localhost/46243] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-09 05:03:29,443 INFO [Listener at localhost/46243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:29,445 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-09 05:03:29,446 INFO [Listener at localhost/46243] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:29,446 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-09 05:03:29,446 INFO [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:29,458 DEBUG [hconnection-0x5fc7cbe8-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:29,470 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33332, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:29,481 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,590 INFO [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:29,590 INFO [Listener at localhost/46243] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:29,590 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,590 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 05:03:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675919009591 (current time:1675919009591). 2023-02-09 05:03:29,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:29,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] zookeeper.ReadOnlyZKClient(139): Connect 0x56c156d0 to 127.0.0.1:53263 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:29,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53dcb82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:29,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:29,597 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56c156d0 to 127.0.0.1:53263 2023-02-09 05:03:29,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:29,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:29,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 05:03:29,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 05:03:29,603 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 05:03:29,603 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675919609603 2023-02-09 05:03:29,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-09 05:03:29,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:29,606 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-09 05:03:29,606 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:29,606 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:29,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 05:03:29,607 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 6 msec 2023-02-09 05:03:29,608 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 05:03:29,608 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675919609608 2023-02-09 05:03:29,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-09 05:03:29,620 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-09 05:03:29,620 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:29,621 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-09 05:03:29,621 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-09 05:03:29,621 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,622 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,624 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:29,624 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:29,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:29,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:29,624 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,625 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,625 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 05:03:29,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 05:03:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 05:03:29,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 05:03:29,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-09 05:03:29,626 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 05:03:29,626 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 05:03:29,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-09 05:03:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 05:03:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46401,1675919007688' joining acquired barrier for procedure (foo) in zk 2023-02-09 05:03:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-09 05:03:29,629 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-09 05:03:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-09 05:03:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34455,1675919007646' joining acquired barrier for procedure (foo) in zk 2023-02-09 05:03:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,632 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,632 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,632 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:29,632 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:29,633 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,633 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:29,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:29,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34455,1675919007646' joining acquired barrier for procedure 'foo' on coordinator 2023-02-09 05:03:29,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61cdef87[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:29,635 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-09 05:03:29,635 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46401,1675919007688' in zk 2023-02-09 05:03:29,636 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,636 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 05:03:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:29,637 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,637 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. started... 2023-02-09 05:03:29,637 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f735cb964d913a22df58df09892e479a 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 05:03:29,639 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 05:03:29,639 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:29,639 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 05:03:29,656 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 2023-02-09 05:03:29,708 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:29,709 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,710 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 05:03:29,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:29,716 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:29,723 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f2/cefbfb8a0e914d089ca0c27a1e7b57eb 2023-02-09 05:03:29,728 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 2023-02-09 05:03:29,732 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:29,733 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f2/cefbfb8a0e914d089ca0c27a1e7b57eb as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb 2023-02-09 05:03:29,737 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:29,737 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for f735cb964d913a22df58df09892e479a in 100ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f735cb964d913a22df58df09892e479a: 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.' region-info for snapshot=foo 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86] hfiles 2023-02-09 05:03:29,738 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 for snapshot=foo 2023-02-09 05:03:29,739 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb] hfiles 2023-02-09 05:03:29,739 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb for snapshot=foo 2023-02-09 05:03:29,758 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. completed. 2023-02-09 05:03:29,758 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:29,758 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 05:03:29,758 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 05:03:29,758 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,758 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-09 05:03:29,758 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34455,1675919007646' in zk 2023-02-09 05:03:29,759 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-09 05:03:29,759 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,759 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:29,760 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-09 05:03:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:29,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34455,1675919007646': 2023-02-09 05:03:29,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34455,1675919007646' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-09 05:03:29,766 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-09 05:03:29,766 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:29,766 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:29,766 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-09 05:03:29,766 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:29,768 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:29,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:29,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,769 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,769 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:29,771 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-09 05:03:29,771 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:29,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,776 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,776 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-09 05:03:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:29,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:29,776 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-09 05:03:29,777 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-09 05:03:29,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:29,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:29,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:29,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:29,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:29,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/.tmp/foo to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/foo 2023-02-09 05:03:29,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-09 05:03:29,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:29,806 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.hbase-snapshot/.tmp/foo 2023-02-09 05:03:29,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675919009604Consolidate snapshot: foo at 1675919009777 (+173 ms)Loading Region manifests for foo at 1675919009777Writing data manifest for foo at 1675919009779 (+2 ms)Verifying snapshot: foo at 1675919009785 (+6 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675919009806 (+21 ms) 2023-02-09 05:03:29,808 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-09 05:03:29,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 202 msec 2023-02-09 05:03:29,916 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:29,916 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,916 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-09 05:03:29,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:29,918 INFO [Listener at localhost/46243] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:29,918 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:29,918 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:29,921 INFO [Listener at localhost/46243] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:29,925 INFO [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:29,954 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34455] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,051 INFO [Listener at localhost/46243] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:30,054 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,054 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:30,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,057 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 05:03:30,057 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:30,058 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-09 05:03:30,058 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-09 05:03:30,059 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,059 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,061 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:30,061 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:30,061 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:30,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:30,061 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,061 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,063 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 05:03:30,063 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:30,063 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-09 05:03:30,063 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:30,064 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 05:03:30,064 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-09 05:03:30,064 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 05:03:30,064 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46401,1675919007688' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 05:03:30,065 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 05:03:30,065 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:30,065 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,065 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. started... 2023-02-09 05:03:30,065 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f735cb964d913a22df58df09892e479a 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 05:03:30,066 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,066 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,066 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:30,082 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f1/4a1960c62c704f92874c8ed6dfdbc59b 2023-02-09 05:03:30,101 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f2/53a49dc2dd594b6082f9e5fbde6aa53a 2023-02-09 05:03:30,105 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f1/4a1960c62c704f92874c8ed6dfdbc59b as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4a1960c62c704f92874c8ed6dfdbc59b 2023-02-09 05:03:30,109 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4a1960c62c704f92874c8ed6dfdbc59b, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:30,109 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/.tmp/f2/53a49dc2dd594b6082f9e5fbde6aa53a as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/53a49dc2dd594b6082f9e5fbde6aa53a 2023-02-09 05:03:30,113 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/53a49dc2dd594b6082f9e5fbde6aa53a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:30,114 INFO [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for f735cb964d913a22df58df09892e479a in 49ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:30,115 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f735cb964d913a22df58df09892e479a: 2023-02-09 05:03:30,115 DEBUG [rs(jenkins-hbase4.apache.org,34455,1675919007646)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 05:03:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 05:03:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-09 05:03:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34455,1675919007646' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-09 05:03:30,117 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:30,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34455,1675919007646' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-09 05:03:30,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65f26766[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:30,119 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-09 05:03:30,119 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 05:03:30,120 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,120 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 05:03:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-09 05:03:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-09 05:03:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,34455,1675919007646' in zk 2023-02-09 05:03:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,46401,1675919007688' in zk 2023-02-09 05:03:30,123 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,123 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 05:03:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:30,123 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:30,123 DEBUG [member: 'jenkins-hbase4.apache.org,34455,1675919007646' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 05:03:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-09 05:03:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:30,124 DEBUG [member: 'jenkins-hbase4.apache.org,46401,1675919007688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-09 05:03:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,34455,1675919007646': 2023-02-09 05:03:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34455,1675919007646' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-09 05:03:30,126 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-09 05:03:30,126 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:30,126 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:30,126 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,126 INFO [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:30,128 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:30,128 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:30,129 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,130 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:30,130 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:30,133 DEBUG [(jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:30,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-09 05:03:30,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:30,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:30,133 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:30,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:30,134 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:30,234 DEBUG [Listener at localhost/46243] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:30,234 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,235 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:30,240 INFO [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675919009591 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:30,240 DEBUG [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33961/user/jenkins/test-data/728d1780-e3db-cc18-50d3-8da2eccae987/foo/93666f13-cc34-4e5c-b296-91eb0fc63165/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,241 INFO [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(239): region to add: f735cb964d913a22df58df09892e479a 2023-02-09 05:03:30,241 INFO [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(585): clone region=f735cb964d913a22df58df09892e479a as f735cb964d913a22df58df09892e479a in snapshot foo 2023-02-09 05:03:30,242 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => f735cb964d913a22df58df09892e479a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33961/user/jenkins/test-data/728d1780-e3db-cc18-50d3-8da2eccae987/foo/93666f13-cc34-4e5c-b296-91eb0fc63165 2023-02-09 05:03:30,249 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:30,249 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4c8a55b0fbe34a1097fbf5cddb6aca86 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,251 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cefbfb8a0e914d089ca0c27a1e7b57eb from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,252 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing f735cb964d913a22df58df09892e479a, disabling compactions & flushes 2023-02-09 05:03:30,252 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,252 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,253 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. after waiting 0 ms 2023-02-09 05:03:30,253 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,253 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,253 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for f735cb964d913a22df58df09892e479a: Waiting for close lock at 1675919010252Disabling compacts and flushes for region at 1675919010252Disabling writes for close at 1675919010253 (+1 ms)Writing region close event to WAL at 1675919010253Closed at 1675919010253 2023-02-09 05:03:30,254 INFO [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675919009591 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:30,254 DEBUG [Listener at localhost/46243] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33961/user/jenkins/test-data/728d1780-e3db-cc18-50d3-8da2eccae987/foo/93666f13-cc34-4e5c-b296-91eb0fc63165 2023-02-09 05:03:30,254 DEBUG [Listener at localhost/46243] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33961/user/jenkins/test-data/728d1780-e3db-cc18-50d3-8da2eccae987/foo/93666f13-cc34-4e5c-b296-91eb0fc63165 2023-02-09 05:03:30,255 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:30,255 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:30,255 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-09 05:03:30,256 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |----------f735cb964d913a22df58df09892e479a/ 2023-02-09 05:03:30,256 DEBUG [Listener at localhost/46243] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:30,256 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:30,256 DEBUG [Listener at localhost/46243] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=f735cb964d913a22df58df09892e479a-4c8a55b0fbe34a1097fbf5cddb6aca86 2023-02-09 05:03:30,256 DEBUG [Listener at localhost/46243] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:30,257 DEBUG [Listener at localhost/46243] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=f735cb964d913a22df58df09892e479a-cefbfb8a0e914d089ca0c27a1e7b57eb hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4a1960c62c704f92874c8ed6dfdbc59b hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/53a49dc2dd594b6082f9e5fbde6aa53a hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb 2023-02-09 05:03:30,261 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,261 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-09 05:03:30,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-09 05:03:30,265 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,265 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,266 INFO [Listener at localhost/46243] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,269 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,269 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919010269"}]},"ts":"1675919010269"} 2023-02-09 05:03:30,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:30,271 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-09 05:03:30,273 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-09 05:03:30,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, UNASSIGN}] 2023-02-09 05:03:30,275 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, UNASSIGN 2023-02-09 05:03:30,276 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f735cb964d913a22df58df09892e479a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,276 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675919010276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919010276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919010276"}]},"ts":"1675919010276"} 2023-02-09 05:03:30,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure f735cb964d913a22df58df09892e479a, server=jenkins-hbase4.apache.org,34455,1675919007646}] 2023-02-09 05:03:30,370 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,370 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:30,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f735cb964d913a22df58df09892e479a 2023-02-09 05:03:30,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f735cb964d913a22df58df09892e479a, disabling compactions & flushes 2023-02-09 05:03:30,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. after waiting 0 ms 2023-02-09 05:03:30,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:30,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a. 2023-02-09 05:03:30,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f735cb964d913a22df58df09892e479a: Waiting for close lock at 1675919010429Running coprocessor pre-close hooks at 1675919010429Disabling compacts and flushes for region at 1675919010429Disabling writes for close at 1675919010429Writing region close event to WAL at 1675919010430 (+1 ms)Running coprocessor post-close hooks at 1675919010433 (+3 ms)Closed at 1675919010433 2023-02-09 05:03:30,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f735cb964d913a22df58df09892e479a 2023-02-09 05:03:30,435 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=f735cb964d913a22df58df09892e479a, regionState=CLOSED 2023-02-09 05:03:30,435 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675919010435"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919010435"}]},"ts":"1675919010435"} 2023-02-09 05:03:30,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 05:03:30,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure f735cb964d913a22df58df09892e479a, server=jenkins-hbase4.apache.org,34455,1675919007646 in 159 msec 2023-02-09 05:03:30,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 05:03:30,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=f735cb964d913a22df58df09892e479a, UNASSIGN in 164 msec 2023-02-09 05:03:30,438 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919010438"}]},"ts":"1675919010438"} 2023-02-09 05:03:30,439 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-09 05:03:30,441 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-09 05:03:30,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-09 05:03:30,572 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,572 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:30,573 INFO [Listener at localhost/46243] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-09 05:03:30,573 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,573 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,577 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,577 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,577 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:30,580 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:30,581 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1, FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2, FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/recovered.edits] 2023-02-09 05:03:30,584 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4a1960c62c704f92874c8ed6dfdbc59b to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4a1960c62c704f92874c8ed6dfdbc59b 2023-02-09 05:03:30,585 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f1/4c8a55b0fbe34a1097fbf5cddb6aca86 2023-02-09 05:03:30,587 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/53a49dc2dd594b6082f9e5fbde6aa53a to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/53a49dc2dd594b6082f9e5fbde6aa53a 2023-02-09 05:03:30,588 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/f2/cefbfb8a0e914d089ca0c27a1e7b57eb 2023-02-09 05:03:30,590 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/recovered.edits/12.seqid to hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a/recovered.edits/12.seqid 2023-02-09 05:03:30,591 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/f735cb964d913a22df58df09892e479a 2023-02-09 05:03:30,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-09 05:03:30,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,594 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-09 05:03:30,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-09 05:03:30,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,599 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-09 05:03:30,599 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919010599"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:30,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 05:03:30,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f735cb964d913a22df58df09892e479a, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675919008834.f735cb964d913a22df58df09892e479a.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 05:03:30,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-09 05:03:30,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675919010600"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:30,601 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-09 05:03:30,603 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-09 05:03:30,604 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 29 msec 2023-02-09 05:03:30,678 INFO [Listener at localhost/46243] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:30,678 INFO [Listener at localhost/46243] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:30,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39215] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:30,679 INFO [Listener at localhost/46243] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-09 05:03:30,679 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:30,679 INFO [Listener at localhost/46243] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:30,679 DEBUG [Listener at localhost/46243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x783129a6 to 127.0.0.1:53263 2023-02-09 05:03:30,680 DEBUG [Listener at localhost/46243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,680 DEBUG [Listener at localhost/46243] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:30,680 DEBUG [Listener at localhost/46243] util.JVMClusterUtil(257): Found active master hash=376401201, stopped=false 2023-02-09 05:03:30,680 INFO [Listener at localhost/46243] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:30,681 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:30,681 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:30,681 INFO [Listener at localhost/46243] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:30,681 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:30,682 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:30,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:30,683 DEBUG [Listener at localhost/46243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75225a37 to 127.0.0.1:53263 2023-02-09 05:03:30,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:30,684 DEBUG [Listener at localhost/46243] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,684 INFO [Listener at localhost/46243] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34455,1675919007646' ***** 2023-02-09 05:03:30,684 INFO [Listener at localhost/46243] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:30,684 INFO [Listener at localhost/46243] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46401,1675919007688' ***** 2023-02-09 05:03:30,684 INFO [Listener at localhost/46243] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:30,684 INFO [RS:1;jenkins-hbase4:46401] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:30,684 INFO [RS:0;jenkins-hbase4:34455] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:30,684 INFO [RS:1;jenkins-hbase4:46401] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:30,684 INFO [RS:0;jenkins-hbase4:34455] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:30,684 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:30,685 INFO [RS:0;jenkins-hbase4:34455] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:30,686 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:30,686 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,685 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:30,686 DEBUG [RS:0;jenkins-hbase4:34455] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d7c70c9 to 127.0.0.1:53263 2023-02-09 05:03:30,686 INFO [RS:1;jenkins-hbase4:46401] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:30,687 DEBUG [RS:0;jenkins-hbase4:34455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(3304): Received CLOSE for 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:30,687 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34455,1675919007646; all regions closed. 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,687 DEBUG [RS:1;jenkins-hbase4:46401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x178f44c3 to 127.0.0.1:53263 2023-02-09 05:03:30,687 DEBUG [RS:1;jenkins-hbase4:46401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:30,687 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8aa368534c8f20e0be7dd817e6cfc0c8, disabling compactions & flushes 2023-02-09 05:03:30,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:30,688 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. after waiting 0 ms 2023-02-09 05:03:30,688 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 8aa368534c8f20e0be7dd817e6cfc0c8=hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8.} 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:30,688 DEBUG [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1505): Waiting on 1588230740, 8aa368534c8f20e0be7dd817e6cfc0c8 2023-02-09 05:03:30,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 8aa368534c8f20e0be7dd817e6cfc0c8 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:30,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:30,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:30,688 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-09 05:03:30,692 DEBUG [RS:0;jenkins-hbase4:34455] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs 2023-02-09 05:03:30,692 INFO [RS:0;jenkins-hbase4:34455] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34455%2C1675919007646:(num 1675919009001) 2023-02-09 05:03:30,692 DEBUG [RS:0;jenkins-hbase4:34455] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,692 INFO [RS:0;jenkins-hbase4:34455] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:30,692 INFO [RS:0;jenkins-hbase4:34455] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:30,692 INFO [RS:0;jenkins-hbase4:34455] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:30,692 INFO [RS:0;jenkins-hbase4:34455] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:30,693 INFO [RS:0;jenkins-hbase4:34455] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:30,692 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:30,694 INFO [RS:0;jenkins-hbase4:34455] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34455 2023-02-09 05:03:30,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/.tmp/info/17d0a62f99464f069abd62d9c03a64f5 2023-02-09 05:03:30,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/info/e93e391cf5934499a2b850770a593f2a 2023-02-09 05:03:30,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e93e391cf5934499a2b850770a593f2a 2023-02-09 05:03:30,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/.tmp/info/17d0a62f99464f069abd62d9c03a64f5 as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/info/17d0a62f99464f069abd62d9c03a64f5 2023-02-09 05:03:30,711 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:30,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/info/17d0a62f99464f069abd62d9c03a64f5, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:30,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8aa368534c8f20e0be7dd817e6cfc0c8 in 25ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:30,716 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/rep_barrier/2f5ff19a698e4ab986e80b978ffd43f8 2023-02-09 05:03:30,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/namespace/8aa368534c8f20e0be7dd817e6cfc0c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:30,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:30,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8aa368534c8f20e0be7dd817e6cfc0c8: Waiting for close lock at 1675919010687Running coprocessor pre-close hooks at 1675919010687Disabling compacts and flushes for region at 1675919010688 (+1 ms)Disabling writes for close at 1675919010688Obtaining lock to block concurrent updates at 1675919010688Preparing flush snapshotting stores in 8aa368534c8f20e0be7dd817e6cfc0c8 at 1675919010688Finished memstore snapshotting hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675919010688Flushing stores of hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. at 1675919010689 (+1 ms)Flushing 8aa368534c8f20e0be7dd817e6cfc0c8/info: creating writer at 1675919010689Flushing 8aa368534c8f20e0be7dd817e6cfc0c8/info: appending metadata at 1675919010692 (+3 ms)Flushing 8aa368534c8f20e0be7dd817e6cfc0c8/info: closing flushed file at 1675919010692Flushing 8aa368534c8f20e0be7dd817e6cfc0c8/info: reopening flushed file at 1675919010709 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8aa368534c8f20e0be7dd817e6cfc0c8 in 25ms, sequenceid=6, compaction requested=false at 1675919010714 (+5 ms)Writing region close event to WAL at 1675919010714Running coprocessor post-close hooks at 1675919010717 (+3 ms)Closed at 1675919010718 (+1 ms) 2023-02-09 05:03:30,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675919008280.8aa368534c8f20e0be7dd817e6cfc0c8. 2023-02-09 05:03:30,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f5ff19a698e4ab986e80b978ffd43f8 2023-02-09 05:03:30,726 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/table/5b33cc5fe3984c51bc8102f229275208 2023-02-09 05:03:30,730 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b33cc5fe3984c51bc8102f229275208 2023-02-09 05:03:30,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/info/e93e391cf5934499a2b850770a593f2a as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/info/e93e391cf5934499a2b850770a593f2a 2023-02-09 05:03:30,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e93e391cf5934499a2b850770a593f2a 2023-02-09 05:03:30,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/info/e93e391cf5934499a2b850770a593f2a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-09 05:03:30,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/rep_barrier/2f5ff19a698e4ab986e80b978ffd43f8 as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/rep_barrier/2f5ff19a698e4ab986e80b978ffd43f8 2023-02-09 05:03:30,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f5ff19a698e4ab986e80b978ffd43f8 2023-02-09 05:03:30,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/rep_barrier/2f5ff19a698e4ab986e80b978ffd43f8, entries=1, sequenceid=21, filesize=5.1 K 2023-02-09 05:03:30,738 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/.tmp/table/5b33cc5fe3984c51bc8102f229275208 as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/table/5b33cc5fe3984c51bc8102f229275208 2023-02-09 05:03:30,741 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b33cc5fe3984c51bc8102f229275208 2023-02-09 05:03:30,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/table/5b33cc5fe3984c51bc8102f229275208, entries=4, sequenceid=21, filesize=5.1 K 2023-02-09 05:03:30,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false 2023-02-09 05:03:30,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 05:03:30,748 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:30,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:30,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919010688Running coprocessor pre-close hooks at 1675919010688Disabling compacts and flushes for region at 1675919010688Disabling writes for close at 1675919010688Obtaining lock to block concurrent updates at 1675919010688Preparing flush snapshotting stores in 1588230740 at 1675919010688Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675919010689 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675919010689Flushing 1588230740/info: creating writer at 1675919010690 (+1 ms)Flushing 1588230740/info: appending metadata at 1675919010692 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675919010692Flushing 1588230740/rep_barrier: creating writer at 1675919010708 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675919010710 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675919010710Flushing 1588230740/table: creating writer at 1675919010720 (+10 ms)Flushing 1588230740/table: appending metadata at 1675919010722 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675919010722Flushing 1588230740/info: reopening flushed file at 1675919010731 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675919010735 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675919010739 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 54ms, sequenceid=21, compaction requested=false at 1675919010742 (+3 ms)Writing region close event to WAL at 1675919010746 (+4 ms)Running coprocessor post-close hooks at 1675919010748 (+2 ms)Closed at 1675919010749 (+1 ms) 2023-02-09 05:03:30,750 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:30,765 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:30,790 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,790 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:30,790 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@721b66b1 rejected from java.util.concurrent.ThreadPoolExecutor@7624fc2a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:30,790 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:30,790 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bd85bf3 rejected from java.util.concurrent.ThreadPoolExecutor@7624fc2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:30,790 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34455,1675919007646 2023-02-09 05:03:30,790 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:30,790 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34455,1675919007646] 2023-02-09 05:03:30,790 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34455,1675919007646; numProcessing=1 2023-02-09 05:03:30,793 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34455,1675919007646 already deleted, retry=false 2023-02-09 05:03:30,793 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34455,1675919007646 expired; onlineServers=1 2023-02-09 05:03:30,888 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46401,1675919007688; all regions closed. 2023-02-09 05:03:30,892 DEBUG [RS:1;jenkins-hbase4:46401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs 2023-02-09 05:03:30,892 INFO [RS:1;jenkins-hbase4:46401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46401%2C1675919007688.meta:.meta(num 1675919008221) 2023-02-09 05:03:30,895 DEBUG [RS:1;jenkins-hbase4:46401] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/oldWALs 2023-02-09 05:03:30,895 INFO [RS:1;jenkins-hbase4:46401] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46401%2C1675919007688:(num 1675919008627) 2023-02-09 05:03:30,895 DEBUG [RS:1;jenkins-hbase4:46401] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,895 INFO [RS:1;jenkins-hbase4:46401] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:30,895 INFO [RS:1;jenkins-hbase4:46401] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:30,895 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:30,896 INFO [RS:1;jenkins-hbase4:46401] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46401 2023-02-09 05:03:30,898 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:30,898 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46401,1675919007688 2023-02-09 05:03:30,898 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45eaef1d rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:30,898 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46401,1675919007688] 2023-02-09 05:03:30,898 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46401,1675919007688; numProcessing=2 2023-02-09 05:03:30,900 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46401,1675919007688 already deleted, retry=false 2023-02-09 05:03:30,900 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46401,1675919007688 expired; onlineServers=0 2023-02-09 05:03:30,900 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39215,1675919007580' ***** 2023-02-09 05:03:30,901 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:30,901 DEBUG [M:0;jenkins-hbase4:39215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1250fb24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:30,901 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39215,1675919007580 2023-02-09 05:03:30,902 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39215,1675919007580; all regions closed. 2023-02-09 05:03:30,902 DEBUG [M:0;jenkins-hbase4:39215] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:30,902 DEBUG [M:0;jenkins-hbase4:39215] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:30,902 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:30,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919007862] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919007862,5,FailOnTimeoutGroup] 2023-02-09 05:03:30,902 DEBUG [M:0;jenkins-hbase4:39215] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:30,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919007862] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919007862,5,FailOnTimeoutGroup] 2023-02-09 05:03:30,902 INFO [M:0;jenkins-hbase4:39215] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:30,903 INFO [M:0;jenkins-hbase4:39215] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:30,903 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:30,903 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:30,903 INFO [M:0;jenkins-hbase4:39215] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:30,903 DEBUG [M:0;jenkins-hbase4:39215] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:30,903 INFO [M:0;jenkins-hbase4:39215] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:30,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:30,904 ERROR [M:0;jenkins-hbase4:39215] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:30,904 INFO [M:0;jenkins-hbase4:39215] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:30,904 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:30,905 DEBUG [M:0;jenkins-hbase4:39215] zookeeper.ZKUtil(398): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:30,905 WARN [M:0;jenkins-hbase4:39215] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:30,905 INFO [M:0;jenkins-hbase4:39215] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:30,905 INFO [M:0;jenkins-hbase4:39215] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:30,905 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:30,905 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:30,905 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:30,905 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:30,905 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:30,905 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.69 KB heapSize=67.70 KB 2023-02-09 05:03:30,918 INFO [M:0;jenkins-hbase4:39215] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.69 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6679f61395d54be99c7a42227e00c968 2023-02-09 05:03:30,922 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6679f61395d54be99c7a42227e00c968 as hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6679f61395d54be99c7a42227e00c968 2023-02-09 05:03:30,926 INFO [M:0;jenkins-hbase4:39215] regionserver.HStore(1080): Added hdfs://localhost:33961/user/jenkins/test-data/7c2006da-dc47-f8c7-6a76-ebf6ea667bd9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6679f61395d54be99c7a42227e00c968, entries=17, sequenceid=132, filesize=8.7 K 2023-02-09 05:03:30,926 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegion(2947): Finished flush of dataSize ~56.69 KB/58051, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false 2023-02-09 05:03:30,927 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:30,927 DEBUG [M:0;jenkins-hbase4:39215] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919010905Disabling compacts and flushes for region at 1675919010905Disabling writes for close at 1675919010905Obtaining lock to block concurrent updates at 1675919010906 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675919010906Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58051, getHeapSize=69304, getOffHeapSize=0, getCellsCount=145 at 1675919010906Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675919010907 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675919010907Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675919010909 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675919010909Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675919010922 (+13 ms)Finished flush of dataSize ~56.69 KB/58051, heapSize ~67.68 KB/69304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=132, compaction requested=false at 1675919010926 (+4 ms)Writing region close event to WAL at 1675919010927 (+1 ms)Closed at 1675919010927 2023-02-09 05:03:30,929 INFO [M:0;jenkins-hbase4:39215] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:30,929 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:30,930 INFO [M:0;jenkins-hbase4:39215] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39215 2023-02-09 05:03:30,931 DEBUG [M:0;jenkins-hbase4:39215] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39215,1675919007580 already deleted, retry=false 2023-02-09 05:03:31,085 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,085 INFO [M:0;jenkins-hbase4:39215] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39215,1675919007580; zookeeper connection closed. 2023-02-09 05:03:31,085 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a198800 rejected from java.util.concurrent.ThreadPoolExecutor@1e261f9b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,086 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): master:39215-0x100377689060000, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,086 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cbacc98 rejected from java.util.concurrent.ThreadPoolExecutor@1e261f9b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,185 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,185 INFO [RS:1;jenkins-hbase4:46401] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46401,1675919007688; zookeeper connection closed. 2023-02-09 05:03:31,185 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@271940ec rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,186 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:46401-0x100377689060002, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,186 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f3d3a7d rejected from java.util.concurrent.ThreadPoolExecutor@41d57378[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,186 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@57e1d841] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@57e1d841 2023-02-09 05:03:31,286 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,286 INFO [RS:0;jenkins-hbase4:34455] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34455,1675919007646; zookeeper connection closed. 2023-02-09 05:03:31,286 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53cbf70a rejected from java.util.concurrent.ThreadPoolExecutor@7624fc2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,286 DEBUG [Listener at localhost/46243-EventThread] zookeeper.ZKWatcher(600): regionserver:34455-0x100377689060001, quorum=127.0.0.1:53263, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:31,286 ERROR [Listener at localhost/46243-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3ae75d94 rejected from java.util.concurrent.ThreadPoolExecutor@7624fc2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:31,286 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75b3abec] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75b3abec 2023-02-09 05:03:31,286 INFO [Listener at localhost/46243] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:31,286 WARN [Listener at localhost/46243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:31,290 INFO [Listener at localhost/46243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:31,391 WARN [BP-446116349-172.31.14.131-1675919006961 heartbeating to localhost/127.0.0.1:33961] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:31,393 WARN [BP-446116349-172.31.14.131-1675919006961 heartbeating to localhost/127.0.0.1:33961] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-446116349-172.31.14.131-1675919006961 (Datanode Uuid a007c79e-90bb-4f05-a365-201f571b95ec) service to localhost/127.0.0.1:33961 2023-02-09 05:03:31,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/dfs/data/data3/current/BP-446116349-172.31.14.131-1675919006961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:31,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/dfs/data/data4/current/BP-446116349-172.31.14.131-1675919006961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:31,395 WARN [Listener at localhost/46243] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:31,401 INFO [Listener at localhost/46243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:31,504 WARN [BP-446116349-172.31.14.131-1675919006961 heartbeating to localhost/127.0.0.1:33961] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:31,507 WARN [BP-446116349-172.31.14.131-1675919006961 heartbeating to localhost/127.0.0.1:33961] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-446116349-172.31.14.131-1675919006961 (Datanode Uuid 9d4449f6-bf8d-4d10-a8f3-4fba039e039b) service to localhost/127.0.0.1:33961 2023-02-09 05:03:31,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/dfs/data/data1/current/BP-446116349-172.31.14.131-1675919006961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:31,508 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/cluster_ec49076a-ca05-829f-f3b3-5cb3dce537f2/dfs/data/data2/current/BP-446116349-172.31.14.131-1675919006961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:31,519 INFO [Listener at localhost/46243] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:31,637 INFO [Listener at localhost/46243] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:31,651 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:31,664 INFO [Listener at localhost/46243] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=276 (was 254) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33961 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33961 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/46243 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33961 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:33961 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:33961 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33961 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:33961 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39215,1675919007580)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=569 (was 665), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=240 (was 252), ProcessCount=167 (was 167), AvailableMemoryMB=3634 (was 3703) 2023-02-09 05:03:31,675 INFO [Listener at localhost/46243] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=276, OpenFileDescriptor=569, MaxFileDescriptor=60000, SystemLoadAverage=240, ProcessCount=167, AvailableMemoryMB=3633 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.log.dir so I do NOT create it in target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae 2023-02-09 05:03:31,686 WARN [Listener at localhost/46243] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.log.dir Erasing configuration value by system value. 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.tmp.dir so I do NOT create it in target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae 2023-02-09 05:03:31,686 WARN [Listener at localhost/46243] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/bdbe4715-a672-26fd-f0a1-eb07d3fb9247/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-09 05:03:31,686 DEBUG [Listener at localhost/46243] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4, deleteOnExit=true 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/test.cache.data in system properties and HBase conf 2023-02-09 05:03:31,686 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop.log.dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 05:03:31,687 DEBUG [Listener at localhost/46243] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:31,687 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/nfs.dump.dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/java.io.tmpdir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 05:03:31,688 INFO [Listener at localhost/46243] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 05:03:31,692 WARN [Listener at localhost/46243] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:31,693 WARN [Listener at localhost/46243] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:31,732 WARN [Listener at localhost/46243] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:31,733 INFO [Listener at localhost/46243] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:31,738 INFO [Listener at localhost/46243] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/java.io.tmpdir/Jetty_localhost_39177_hdfs____k00n6d/webapp 2023-02-09 05:03:31,830 INFO [Listener at localhost/46243] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39177 2023-02-09 05:03:31,835 WARN [Listener at localhost/46243] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 05:03:31,835 WARN [Listener at localhost/46243] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 05:03:31,883 WARN [Listener at localhost/41037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:31,898 WARN [Listener at localhost/41037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:31,901 WARN [Listener at localhost/41037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:31,902 INFO [Listener at localhost/41037] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:31,909 INFO [Listener at localhost/41037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/java.io.tmpdir/Jetty_localhost_37479_datanode____7sl5l/webapp 2023-02-09 05:03:32,000 INFO [Listener at localhost/41037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37479 2023-02-09 05:03:32,008 WARN [Listener at localhost/33527] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:32,025 WARN [Listener at localhost/33527] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 05:03:32,027 WARN [Listener at localhost/33527] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 05:03:32,028 INFO [Listener at localhost/33527] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 05:03:32,031 INFO [Listener at localhost/33527] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/java.io.tmpdir/Jetty_localhost_43807_datanode____b8lb9j/webapp 2023-02-09 05:03:32,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87bad8ba782cd923: Processing first storage report for DS-995a47d8-f469-4125-87a5-ceeb50b77f96 from datanode 7fd80a74-0206-4568-857b-6c2507457245 2023-02-09 05:03:32,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87bad8ba782cd923: from storage DS-995a47d8-f469-4125-87a5-ceeb50b77f96 node DatanodeRegistration(127.0.0.1:46637, datanodeUuid=7fd80a74-0206-4568-857b-6c2507457245, infoPort=45787, infoSecurePort=0, ipcPort=33527, storageInfo=lv=-57;cid=testClusterID;nsid=518602397;c=1675919011695), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:32,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87bad8ba782cd923: Processing first storage report for DS-60a2aa69-e466-4629-8424-75f7afed79e7 from datanode 7fd80a74-0206-4568-857b-6c2507457245 2023-02-09 05:03:32,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87bad8ba782cd923: from storage DS-60a2aa69-e466-4629-8424-75f7afed79e7 node DatanodeRegistration(127.0.0.1:46637, datanodeUuid=7fd80a74-0206-4568-857b-6c2507457245, infoPort=45787, infoSecurePort=0, ipcPort=33527, storageInfo=lv=-57;cid=testClusterID;nsid=518602397;c=1675919011695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:32,149 INFO [Listener at localhost/33527] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43807 2023-02-09 05:03:32,159 WARN [Listener at localhost/38219] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 05:03:32,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23a833e4645050cd: Processing first storage report for DS-ba604acf-e22f-4570-973c-82a6d802c905 from datanode 7d05aa60-3879-4e64-bfcf-581aa0fd357e 2023-02-09 05:03:32,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23a833e4645050cd: from storage DS-ba604acf-e22f-4570-973c-82a6d802c905 node DatanodeRegistration(127.0.0.1:44537, datanodeUuid=7d05aa60-3879-4e64-bfcf-581aa0fd357e, infoPort=39853, infoSecurePort=0, ipcPort=38219, storageInfo=lv=-57;cid=testClusterID;nsid=518602397;c=1675919011695), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:32,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x23a833e4645050cd: Processing first storage report for DS-58282c83-d777-47eb-bf08-da1dc47ac93d from datanode 7d05aa60-3879-4e64-bfcf-581aa0fd357e 2023-02-09 05:03:32,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x23a833e4645050cd: from storage DS-58282c83-d777-47eb-bf08-da1dc47ac93d node DatanodeRegistration(127.0.0.1:44537, datanodeUuid=7d05aa60-3879-4e64-bfcf-581aa0fd357e, infoPort=39853, infoSecurePort=0, ipcPort=38219, storageInfo=lv=-57;cid=testClusterID;nsid=518602397;c=1675919011695), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 05:03:32,268 DEBUG [Listener at localhost/38219] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae 2023-02-09 05:03:32,270 INFO [Listener at localhost/38219] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/zookeeper_0, clientPort=59719, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 05:03:32,271 INFO [Listener at localhost/38219] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59719 2023-02-09 05:03:32,271 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,272 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,291 INFO [Listener at localhost/38219] util.FSUtils(479): Created version file at hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1 with version=8 2023-02-09 05:03:32,291 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,292 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,293 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/hbase-staging 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:32,295 INFO [Listener at localhost/38219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:32,296 INFO [Listener at localhost/38219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36533 2023-02-09 05:03:32,296 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,297 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,298 INFO [Listener at localhost/38219] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36533 connecting to ZooKeeper ensemble=127.0.0.1:59719 2023-02-09 05:03:32,310 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:365330x0, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:32,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36533-0x10037769b730000 connected 2023-02-09 05:03:32,328 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:32,329 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:32,329 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:32,337 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36533 2023-02-09 05:03:32,340 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36533 2023-02-09 05:03:32,340 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36533 2023-02-09 05:03:32,343 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36533 2023-02-09 05:03:32,343 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36533 2023-02-09 05:03:32,343 INFO [Listener at localhost/38219] master.HMaster(439): hbase.rootdir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1, hbase.cluster.distributed=false 2023-02-09 05:03:32,356 INFO [Listener at localhost/38219] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:32,356 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,356 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,357 INFO [Listener at localhost/38219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:32,357 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,357 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:32,357 INFO [Listener at localhost/38219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:32,358 INFO [Listener at localhost/38219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42223 2023-02-09 05:03:32,358 INFO [Listener at localhost/38219] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:32,360 DEBUG [Listener at localhost/38219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:32,360 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,361 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,362 INFO [Listener at localhost/38219] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42223 connecting to ZooKeeper ensemble=127.0.0.1:59719 2023-02-09 05:03:32,364 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:422230x0, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:32,364 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:422230x0, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:32,365 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:422230x0, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:32,365 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:422230x0, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:32,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42223-0x10037769b730001 connected 2023-02-09 05:03:32,370 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-09 05:03:32,371 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42223 2023-02-09 05:03:32,376 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42223 2023-02-09 05:03:32,376 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-09 05:03:32,376 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42223 2023-02-09 05:03:32,387 INFO [Listener at localhost/38219] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 05:03:32,388 INFO [Listener at localhost/38219] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 05:03:32,389 INFO [Listener at localhost/38219] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42955 2023-02-09 05:03:32,389 INFO [Listener at localhost/38219] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 05:03:32,389 DEBUG [Listener at localhost/38219] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:32,390 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,391 INFO [Listener at localhost/38219] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,391 INFO [Listener at localhost/38219] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42955 connecting to ZooKeeper ensemble=127.0.0.1:59719 2023-02-09 05:03:32,394 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:429550x0, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 05:03:32,394 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:429550x0, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:32,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42955-0x10037769b730002 connected 2023-02-09 05:03:32,395 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:32,396 DEBUG [Listener at localhost/38219] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 05:03:32,398 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42955 2023-02-09 05:03:32,400 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42955 2023-02-09 05:03:32,402 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42955 2023-02-09 05:03:32,402 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42955 2023-02-09 05:03:32,402 DEBUG [Listener at localhost/38219] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42955 2023-02-09 05:03:32,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,406 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:32,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,409 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:32,409 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:32,409 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,412 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:32,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:32,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 05:03:32,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36533,1675919012294 from backup master directory 2023-02-09 05:03:32,415 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,415 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 05:03:32,415 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:32,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/hbase.id with ID: a5c6ef5d-e32e-4184-afeb-f097827ea3f0 2023-02-09 05:03:32,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 05:03:32,449 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x14471f03 to 127.0.0.1:59719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:32,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11b55279, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:32,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:32,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 05:03:32,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:32,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store-tmp 2023-02-09 05:03:32,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:32,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:32,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919012480Disabling compacts and flushes for region at 1675919012480Disabling writes for close at 1675919012480Writing region close event to WAL at 1675919012480Closed at 1675919012480 2023-02-09 05:03:32,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/WALs/jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36533%2C1675919012294, suffix=, logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/WALs/jenkins-hbase4.apache.org,36533,1675919012294, archiveDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/oldWALs, maxLogs=10 2023-02-09 05:03:32,495 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK] 2023-02-09 05:03:32,495 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK] 2023-02-09 05:03:32,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/WALs/jenkins-hbase4.apache.org,36533,1675919012294/jenkins-hbase4.apache.org%2C36533%2C1675919012294.1675919012482 2023-02-09 05:03:32,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK], DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK]] 2023-02-09 05:03:32,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:32,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:32,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,504 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,505 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 05:03:32,505 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 05:03:32,506 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 05:03:32,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:32,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65772071, jitterRate=-0.01991976797580719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:32,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675919012500Initializing all the Stores at 1675919012501 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919012501Cleaning up temporary data from old regions at 1675919012507 (+6 ms)Cleaning up detritus from prior splits at 1675919012507Region opened successfully at 1675919012513 (+6 ms) 2023-02-09 05:03:32,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 05:03:32,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 05:03:32,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 05:03:32,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 05:03:32,517 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-09 05:03:32,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-09 05:03:32,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 05:03:32,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 05:03:32,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 05:03:32,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 05:03:32,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 05:03:32,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 05:03:32,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 05:03:32,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 05:03:32,539 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 05:03:32,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 05:03:32,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 05:03:32,542 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:32,542 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:32,542 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,542 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:32,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36533,1675919012294, sessionid=0x10037769b730000, setting cluster-up flag (Was=false) 2023-02-09 05:03:32,549 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 05:03:32,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,557 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 05:03:32,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:32,562 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/.tmp 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:32,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675919042570 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 05:03:32,570 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:32,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,570 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 05:03:32,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 05:03:32,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 05:03:32,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 05:03:32,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 05:03:32,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 05:03:32,572 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:32,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919012572,5,FailOnTimeoutGroup] 2023-02-09 05:03:32,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919012577,5,FailOnTimeoutGroup] 2023-02-09 05:03:32,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 05:03:32,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,590 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:32,590 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:32,590 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1 2023-02-09 05:03:32,601 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:32,605 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:32,608 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(952): ClusterId : a5c6ef5d-e32e-4184-afeb-f097827ea3f0 2023-02-09 05:03:32,608 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:32,608 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(952): ClusterId : a5c6ef5d-e32e-4184-afeb-f097827ea3f0 2023-02-09 05:03:32,608 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 05:03:32,608 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/info 2023-02-09 05:03:32,608 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:32,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,609 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:32,610 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:32,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:32,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,611 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:32,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:32,611 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:32,611 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 05:03:32,612 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 05:03:32,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/table 2023-02-09 05:03:32,612 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:32,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,613 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:32,614 DEBUG [RS:1;jenkins-hbase4:42955] zookeeper.ReadOnlyZKClient(139): Connect 0x18dfc4dc to 127.0.0.1:59719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:32,614 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 05:03:32,614 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740 2023-02-09 05:03:32,615 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740 2023-02-09 05:03:32,617 DEBUG [RS:0;jenkins-hbase4:42223] zookeeper.ReadOnlyZKClient(139): Connect 0x3fd9fadf to 127.0.0.1:59719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:32,617 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:32,618 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:32,628 DEBUG [RS:0;jenkins-hbase4:42223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@311e1354, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:32,628 DEBUG [RS:1;jenkins-hbase4:42955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@161839b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:32,628 DEBUG [RS:0;jenkins-hbase4:42223] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@352191af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:32,628 DEBUG [RS:1;jenkins-hbase4:42955] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1227afac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:32,628 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:32,629 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65007976, jitterRate=-0.031305670738220215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:32,629 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675919012601Initializing all the Stores at 1675919012601Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919012601Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919012605 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919012605Cleaning up temporary data from old regions at 1675919012616 (+11 ms)Cleaning up detritus from prior splits at 1675919012617 (+1 ms)Region opened successfully at 1675919012629 (+12 ms) 2023-02-09 05:03:32,629 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:32,629 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:32,629 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:32,629 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:32,629 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:32,630 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:32,630 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919012629Disabling compacts and flushes for region at 1675919012629Disabling writes for close at 1675919012629Writing region close event to WAL at 1675919012630 (+1 ms)Closed at 1675919012630 2023-02-09 05:03:32,630 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 05:03:32,630 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 05:03:32,631 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 05:03:32,633 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 05:03:32,634 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 05:03:32,641 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42955 2023-02-09 05:03:32,641 INFO [RS:1;jenkins-hbase4:42955] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:32,641 INFO [RS:1;jenkins-hbase4:42955] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:32,641 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:32,641 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36533,1675919012294 with isa=jenkins-hbase4.apache.org/172.31.14.131:42955, startcode=1675919012387 2023-02-09 05:03:32,642 DEBUG [RS:1;jenkins-hbase4:42955] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:32,643 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42223 2023-02-09 05:03:32,643 INFO [RS:0;jenkins-hbase4:42223] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 05:03:32,643 INFO [RS:0;jenkins-hbase4:42223] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 05:03:32,643 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 05:03:32,643 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33539, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:32,643 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36533,1675919012294 with isa=jenkins-hbase4.apache.org/172.31.14.131:42223, startcode=1675919012356 2023-02-09 05:03:32,644 DEBUG [RS:0;jenkins-hbase4:42223] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 05:03:32,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,647 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1 2023-02-09 05:03:32,647 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41037 2023-02-09 05:03:32,647 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:32,647 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47107, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 05:03:32,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,648 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:32,648 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1 2023-02-09 05:03:32,648 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41037 2023-02-09 05:03:32,648 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 05:03:32,648 DEBUG [RS:1;jenkins-hbase4:42955] zookeeper.ZKUtil(162): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,648 WARN [RS:1;jenkins-hbase4:42955] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:32,649 INFO [RS:1;jenkins-hbase4:42955] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:32,649 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,655 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42223,1675919012356] 2023-02-09 05:03:32,655 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42955,1675919012387] 2023-02-09 05:03:32,655 DEBUG [RS:0;jenkins-hbase4:42223] zookeeper.ZKUtil(162): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,655 WARN [RS:0;jenkins-hbase4:42223] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 05:03:32,655 INFO [RS:0;jenkins-hbase4:42223] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:32,655 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,655 DEBUG [RS:1;jenkins-hbase4:42955] zookeeper.ZKUtil(162): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,657 DEBUG [RS:1;jenkins-hbase4:42955] zookeeper.ZKUtil(162): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,658 DEBUG [RS:1;jenkins-hbase4:42955] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:32,658 INFO [RS:1;jenkins-hbase4:42955] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:32,659 DEBUG [RS:0;jenkins-hbase4:42223] zookeeper.ZKUtil(162): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,659 DEBUG [RS:0;jenkins-hbase4:42223] zookeeper.ZKUtil(162): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,660 INFO [RS:1;jenkins-hbase4:42955] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:32,660 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 05:03:32,660 INFO [RS:0;jenkins-hbase4:42223] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 05:03:32,664 INFO [RS:1;jenkins-hbase4:42955] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:32,664 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,667 INFO [RS:0;jenkins-hbase4:42223] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 05:03:32,667 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:32,670 INFO [RS:0;jenkins-hbase4:42223] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 05:03:32,671 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,671 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 05:03:32,673 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,674 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,674 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,674 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,674 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,674 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,674 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:1;jenkins-hbase4:42955] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,677 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,678 DEBUG [RS:0;jenkins-hbase4:42223] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-09 05:03:32,680 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,680 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,680 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,684 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,684 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,685 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,694 INFO [RS:1;jenkins-hbase4:42955] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:32,694 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42955,1675919012387-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,695 INFO [RS:0;jenkins-hbase4:42223] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 05:03:32,695 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42223,1675919012356-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,707 INFO [RS:0;jenkins-hbase4:42223] regionserver.Replication(203): jenkins-hbase4.apache.org,42223,1675919012356 started 2023-02-09 05:03:32,707 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42223,1675919012356, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42223, sessionid=0x10037769b730001 2023-02-09 05:03:32,707 INFO [RS:1;jenkins-hbase4:42955] regionserver.Replication(203): jenkins-hbase4.apache.org,42955,1675919012387 started 2023-02-09 05:03:32,707 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:32,707 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42955,1675919012387, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42955, sessionid=0x10037769b730002 2023-02-09 05:03:32,707 DEBUG [RS:0;jenkins-hbase4:42223] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,707 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 05:03:32,707 DEBUG [RS:1;jenkins-hbase4:42955] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,707 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42955,1675919012387' 2023-02-09 05:03:32,707 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42223,1675919012356' 2023-02-09 05:03:32,707 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:32,707 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:32,708 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:32,708 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:32,708 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:32,708 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:32,708 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 05:03:32,708 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 05:03:32,708 DEBUG [RS:1;jenkins-hbase4:42955] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:32,708 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42955,1675919012387' 2023-02-09 05:03:32,708 DEBUG [RS:0;jenkins-hbase4:42223] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,709 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42223,1675919012356' 2023-02-09 05:03:32,709 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:32,709 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:32,709 DEBUG [RS:1;jenkins-hbase4:42955] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:32,709 DEBUG [RS:0;jenkins-hbase4:42223] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:32,709 DEBUG [RS:0;jenkins-hbase4:42223] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:32,709 DEBUG [RS:1;jenkins-hbase4:42955] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 05:03:32,709 INFO [RS:0;jenkins-hbase4:42223] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:32,709 INFO [RS:1;jenkins-hbase4:42955] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 05:03:32,709 INFO [RS:1;jenkins-hbase4:42955] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:32,709 INFO [RS:0;jenkins-hbase4:42223] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 05:03:32,784 DEBUG [jenkins-hbase4:36533] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-09 05:03:32,785 DEBUG [jenkins-hbase4:36533] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:32,786 DEBUG [jenkins-hbase4:36533] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:32,786 DEBUG [jenkins-hbase4:36533] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:32,786 DEBUG [jenkins-hbase4:36533] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:32,786 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42223,1675919012356, state=OPENING 2023-02-09 05:03:32,788 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 05:03:32,790 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:32,791 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:32,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42223,1675919012356}] 2023-02-09 05:03:32,946 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:32,946 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:32,948 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:32,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 05:03:32,951 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 05:03:32,952 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42223%2C1675919012356.meta, suffix=.meta, logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42223,1675919012356, archiveDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs, maxLogs=32 2023-02-09 05:03:32,967 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK] 2023-02-09 05:03:32,967 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK] 2023-02-09 05:03:32,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42223,1675919012356/jenkins-hbase4.apache.org%2C42223%2C1675919012356.meta.1675919012952.meta 2023-02-09 05:03:32,968 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK], DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK]] 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 05:03:32,969 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 05:03:32,969 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 05:03:32,970 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 05:03:32,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/info 2023-02-09 05:03:32,971 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/info 2023-02-09 05:03:32,971 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 05:03:32,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 05:03:32,972 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:32,972 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/rep_barrier 2023-02-09 05:03:32,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 05:03:32,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 05:03:32,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/table 2023-02-09 05:03:32,973 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/table 2023-02-09 05:03:32,973 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 05:03:32,974 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:32,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740 2023-02-09 05:03:32,975 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740 2023-02-09 05:03:32,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 05:03:32,977 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 05:03:32,978 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60101794, jitterRate=-0.1044134795665741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 05:03:32,978 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675919012969Writing region info on filesystem at 1675919012969Initializing all the Stores at 1675919012970 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919012970Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919012970Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919012970Cleaning up temporary data from old regions at 1675919012976 (+6 ms)Cleaning up detritus from prior splits at 1675919012976Running coprocessor post-open hooks at 1675919012978 (+2 ms)Region opened successfully at 1675919012978 2023-02-09 05:03:32,979 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675919012946 2023-02-09 05:03:32,982 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 05:03:32,983 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 05:03:32,983 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42223,1675919012356, state=OPEN 2023-02-09 05:03:32,984 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 05:03:32,984 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 05:03:32,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 05:03:32,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42223,1675919012356 in 193 msec 2023-02-09 05:03:32,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 05:03:32,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-09 05:03:32,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 424 msec 2023-02-09 05:03:32,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675919012406, completionTime=-1 2023-02-09 05:03:32,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-09 05:03:32,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 05:03:32,991 DEBUG [hconnection-0x7bcd18ff-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:32,992 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:32,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-09 05:03:32,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675919072993 2023-02-09 05:03:32,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675919132993 2023-02-09 05:03:32,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-09 05:03:32,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36533,1675919012294-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36533,1675919012294-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36533,1675919012294-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36533, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 05:03:32,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:32,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 05:03:32,999 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 05:03:33,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:33,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:33,001 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,002 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899 empty. 2023-02-09 05:03:33,002 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,002 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 05:03:33,010 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:33,011 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ef80ab76fe4b9cba1b3aeb72d811d899, NAME => 'hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp 2023-02-09 05:03:33,017 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:33,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ef80ab76fe4b9cba1b3aeb72d811d899, disabling compactions & flushes 2023-02-09 05:03:33,018 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. after waiting 0 ms 2023-02-09 05:03:33,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,018 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,018 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ef80ab76fe4b9cba1b3aeb72d811d899: Waiting for close lock at 1675919013018Disabling compacts and flushes for region at 1675919013018Disabling writes for close at 1675919013018Writing region close event to WAL at 1675919013018Closed at 1675919013018 2023-02-09 05:03:33,019 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:33,020 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919013020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919013020"}]},"ts":"1675919013020"} 2023-02-09 05:03:33,021 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:33,022 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:33,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919013022"}]},"ts":"1675919013022"} 2023-02-09 05:03:33,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 05:03:33,027 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:33,027 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:33,027 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:33,027 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:33,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ef80ab76fe4b9cba1b3aeb72d811d899, ASSIGN}] 2023-02-09 05:03:33,030 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ef80ab76fe4b9cba1b3aeb72d811d899, ASSIGN 2023-02-09 05:03:33,030 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ef80ab76fe4b9cba1b3aeb72d811d899, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42223,1675919012356; forceNewPlan=false, retain=false 2023-02-09 05:03:33,180 INFO [jenkins-hbase4:36533] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:33,181 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ef80ab76fe4b9cba1b3aeb72d811d899, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:33,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919013181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919013181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919013181"}]},"ts":"1675919013181"} 2023-02-09 05:03:33,183 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ef80ab76fe4b9cba1b3aeb72d811d899, server=jenkins-hbase4.apache.org,42223,1675919012356}] 2023-02-09 05:03:33,337 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,338 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42223%2C1675919012356, suffix=, logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42223,1675919012356, archiveDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs, maxLogs=32 2023-02-09 05:03:33,351 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK] 2023-02-09 05:03:33,352 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK] 2023-02-09 05:03:33,353 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42223,1675919012356/jenkins-hbase4.apache.org%2C42223%2C1675919012356.1675919013338 2023-02-09 05:03:33,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK], DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK]] 2023-02-09 05:03:33,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ef80ab76fe4b9cba1b3aeb72d811d899, NAME => 'hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:33,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:33,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,355 INFO [StoreOpener-ef80ab76fe4b9cba1b3aeb72d811d899-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,356 DEBUG [StoreOpener-ef80ab76fe4b9cba1b3aeb72d811d899-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/info 2023-02-09 05:03:33,356 DEBUG [StoreOpener-ef80ab76fe4b9cba1b3aeb72d811d899-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/info 2023-02-09 05:03:33,356 INFO [StoreOpener-ef80ab76fe4b9cba1b3aeb72d811d899-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ef80ab76fe4b9cba1b3aeb72d811d899 columnFamilyName info 2023-02-09 05:03:33,357 INFO [StoreOpener-ef80ab76fe4b9cba1b3aeb72d811d899-1] regionserver.HStore(310): Store=ef80ab76fe4b9cba1b3aeb72d811d899/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:33,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,359 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:33,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:33,361 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ef80ab76fe4b9cba1b3aeb72d811d899; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67216697, jitterRate=0.0016068369150161743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 05:03:33,361 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ef80ab76fe4b9cba1b3aeb72d811d899: Running coprocessor pre-open hook at 1675919013354Writing region info on filesystem at 1675919013354Initializing all the Stores at 1675919013354Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675919013354Cleaning up temporary data from old regions at 1675919013358 (+4 ms)Cleaning up detritus from prior splits at 1675919013358Running coprocessor post-open hooks at 1675919013361 (+3 ms)Region opened successfully at 1675919013361 2023-02-09 05:03:33,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899., pid=6, masterSystemTime=1675919013334 2023-02-09 05:03:33,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:33,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ef80ab76fe4b9cba1b3aeb72d811d899, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:33,363 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675919013363"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919013363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919013363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919013363"}]},"ts":"1675919013363"} 2023-02-09 05:03:33,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 05:03:33,366 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ef80ab76fe4b9cba1b3aeb72d811d899, server=jenkins-hbase4.apache.org,42223,1675919012356 in 182 msec 2023-02-09 05:03:33,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 05:03:33,367 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ef80ab76fe4b9cba1b3aeb72d811d899, ASSIGN in 339 msec 2023-02-09 05:03:33,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:33,368 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919013368"}]},"ts":"1675919013368"} 2023-02-09 05:03:33,369 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 05:03:33,371 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:33,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 373 msec 2023-02-09 05:03:33,400 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 05:03:33,400 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:33,401 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:33,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 05:03:33,410 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:33,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-09 05:03:33,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 05:03:33,422 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 05:03:33,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-09 05:03:33,439 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 05:03:33,441 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.026sec 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36533,1675919012294-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 05:03:33,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36533,1675919012294-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 05:03:33,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 05:03:33,507 DEBUG [Listener at localhost/38219] zookeeper.ReadOnlyZKClient(139): Connect 0x1ec593d2 to 127.0.0.1:59719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:33,511 DEBUG [Listener at localhost/38219] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e8d33bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:33,512 DEBUG [hconnection-0x5f185767-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:33,514 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56948, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:33,516 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:33,516 DEBUG [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-09 05:03:33,516 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,516 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,519 DEBUG [Listener at localhost/38219] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 05:03:33,520 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 05:03:33,521 INFO [Listener at localhost/38219] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 05:03:33,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 05:03:33,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-09 05:03:33,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:43070 deadline: 1675919073521, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-09 05:03:33,522 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-09 05:03:33,522 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,523 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:33,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 05:03:33,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-09 05:03:33,527 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 05:03:33,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-09 05:03:33,531 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,531 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:33,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:33,532 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 05:03:33,533 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,534 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 empty. 2023-02-09 05:03:33,534 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,534 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 05:03:33,542 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-09 05:03:33,543 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2c99d732a93eb1f83a91b3716108c276, NAME => 'testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2c99d732a93eb1f83a91b3716108c276, disabling compactions & flushes 2023-02-09 05:03:33,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. after waiting 0 ms 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,549 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,549 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2c99d732a93eb1f83a91b3716108c276: Waiting for close lock at 1675919013549Disabling compacts and flushes for region at 1675919013549Disabling writes for close at 1675919013549Writing region close event to WAL at 1675919013549Closed at 1675919013549 2023-02-09 05:03:33,550 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 05:03:33,551 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675919013551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919013551"}]},"ts":"1675919013551"} 2023-02-09 05:03:33,552 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 05:03:33,553 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 05:03:33,553 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919013553"}]},"ts":"1675919013553"} 2023-02-09 05:03:33,554 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-09 05:03:33,557 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-09 05:03:33,558 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-09 05:03:33,558 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-09 05:03:33,558 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-09 05:03:33,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, ASSIGN}] 2023-02-09 05:03:33,560 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, ASSIGN 2023-02-09 05:03:33,561 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42955,1675919012387; forceNewPlan=false, retain=false 2023-02-09 05:03:33,632 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,632 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:33,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:33,711 INFO [jenkins-hbase4:36533] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-09 05:03:33,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2c99d732a93eb1f83a91b3716108c276, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:33,711 INFO [RS:1;jenkins-hbase4:42955] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42955%2C1675919012387, suffix=, logDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42955,1675919012387, archiveDir=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs, maxLogs=32 2023-02-09 05:03:33,712 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675919013711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919013711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919013711"}]},"ts":"1675919013711"} 2023-02-09 05:03:33,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 2c99d732a93eb1f83a91b3716108c276, server=jenkins-hbase4.apache.org,42955,1675919012387}] 2023-02-09 05:03:33,751 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK] 2023-02-09 05:03:33,751 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK] 2023-02-09 05:03:33,756 INFO [RS:1;jenkins-hbase4:42955] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/WALs/jenkins-hbase4.apache.org,42955,1675919012387/jenkins-hbase4.apache.org%2C42955%2C1675919012387.1675919013712 2023-02-09 05:03:33,760 DEBUG [RS:1;jenkins-hbase4:42955] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK], DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK]] 2023-02-09 05:03:33,834 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:33,834 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:33,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:33,868 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:33,868 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 05:03:33,870 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 05:03:33,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c99d732a93eb1f83a91b3716108c276, NAME => 'testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.', STARTKEY => '', ENDKEY => ''} 2023-02-09 05:03:33,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:33,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,875 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,876 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1 2023-02-09 05:03:33,876 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1 2023-02-09 05:03:33,876 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c99d732a93eb1f83a91b3716108c276 columnFamilyName f1 2023-02-09 05:03:33,877 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(310): Store=2c99d732a93eb1f83a91b3716108c276/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:33,877 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,878 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2 2023-02-09 05:03:33,878 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2 2023-02-09 05:03:33,878 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c99d732a93eb1f83a91b3716108c276 columnFamilyName f2 2023-02-09 05:03:33,879 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(310): Store=2c99d732a93eb1f83a91b3716108c276/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:33,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:33,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:33,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 05:03:33,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2c99d732a93eb1f83a91b3716108c276; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68360616, jitterRate=0.01865255832672119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:33,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2c99d732a93eb1f83a91b3716108c276: Running coprocessor pre-open hook at 1675919013874Writing region info on filesystem at 1675919013874Initializing all the Stores at 1675919013875 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919013875Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919013875Cleaning up temporary data from old regions at 1675919013881 (+6 ms)Cleaning up detritus from prior splits at 1675919013881Running coprocessor post-open hooks at 1675919013886 (+5 ms)Region opened successfully at 1675919013886 2023-02-09 05:03:33,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276., pid=12, masterSystemTime=1675919013868 2023-02-09 05:03:33,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:33,894 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=2c99d732a93eb1f83a91b3716108c276, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:33,894 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675919013894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675919013894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675919013894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675919013894"}]},"ts":"1675919013894"} 2023-02-09 05:03:33,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-09 05:03:33,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 2c99d732a93eb1f83a91b3716108c276, server=jenkins-hbase4.apache.org,42955,1675919012387 in 184 msec 2023-02-09 05:03:33,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 05:03:33,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, ASSIGN in 341 msec 2023-02-09 05:03:33,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 05:03:33,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919013901"}]},"ts":"1675919013901"} 2023-02-09 05:03:33,902 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-09 05:03:33,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 05:03:33,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 380 msec 2023-02-09 05:03:34,136 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,136 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-09 05:03:34,138 INFO [Listener at localhost/38219] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-09 05:03:34,138 DEBUG [Listener at localhost/38219] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-09 05:03:34,138 INFO [Listener at localhost/38219] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:34,139 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-09 05:03:34,140 INFO [Listener at localhost/38219] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 05:03:34,140 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-09 05:03:34,140 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-09 05:03:34,148 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:34,156 DEBUG [hconnection-0x5f185767-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:34,171 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36876, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:34,180 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42955] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:34,398 INFO [AsyncFSWAL-0-hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1-prefix:jenkins-hbase4.apache.org,42955,1675919012387] wal.AbstractFSWAL(1045): Slow sync cost: 149 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:44537,DS-ba604acf-e22f-4570-973c-82a6d802c905,DISK], DatanodeInfoWithStorage[127.0.0.1:46637,DS-995a47d8-f469-4125-87a5-ceeb50b77f96,DISK]] 2023-02-09 05:03:34,484 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-09 05:03:34,484 INFO [Listener at localhost/38219] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-09 05:03:34,484 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,484 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675919014486 (current time:1675919014486). 2023-02-09 05:03:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 05:03:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] zookeeper.ReadOnlyZKClient(139): Connect 0x364bb311 to 127.0.0.1:59719 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 05:03:34,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@563451c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 05:03:34,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 05:03:34,492 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 05:03:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x364bb311 to 127.0.0.1:59719 2023-02-09 05:03:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 05:03:34,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:34,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:34,498 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:34,498 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675919614498 2023-02-09 05:03:34,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-09 05:03:34,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-09 05:03:34,502 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-09 05:03:34,502 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:34,502 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 05:03:34,502 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:34,503 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-09 05:03:34,503 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:34,504 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675919614504 2023-02-09 05:03:34,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-09 05:03:34,518 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-09 05:03:34,518 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:34,519 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-09 05:03:34,519 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-09 05:03:34,520 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,520 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,521 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:34,521 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:34,521 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:34,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:34,521 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,521 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:34,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 05:03:34,522 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-09 05:03:34,524 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 05:03:34,524 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:34,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-09 05:03:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 05:03:34,525 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42955,1675919012387' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 05:03:34,528 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-09 05:03:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 05:03:34,528 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,534 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-09 05:03:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-09 05:03:34,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:34,535 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42223,1675919012356' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-09 05:03:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:34,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,534 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:34,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,537 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:34,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42955,1675919012387' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-09 05:03:34,537 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,537 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-09 05:03:34,537 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:34,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70c4686e[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:34,537 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,539 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:34,539 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 05:03:34,539 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42223,1675919012356' in zk 2023-02-09 05:03:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-09 05:03:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-09 05:03:34,544 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,544 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 05:03:34,544 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:34,544 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. started... 2023-02-09 05:03:34,545 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 2c99d732a93eb1f83a91b3716108c276 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-09 05:03:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:34,546 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 05:03:34,569 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f1/ba6c8fac17d04c38b4f85786770f9f95 2023-02-09 05:03:34,591 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f2/9776378300054b6e8e3669aea23a2df4 2023-02-09 05:03:34,596 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f1/ba6c8fac17d04c38b4f85786770f9f95 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95 2023-02-09 05:03:34,602 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:34,602 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,602 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-09 05:03:34,604 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 05:03:34,606 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:34,607 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f2/9776378300054b6e8e3669aea23a2df4 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4 2023-02-09 05:03:34,616 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-09 05:03:34,616 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 2c99d732a93eb1f83a91b3716108c276 in 72ms, sequenceid=5, compaction requested=false 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 2c99d732a93eb1f83a91b3716108c276: 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95] hfiles 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95 for snapshot=testWithMapReduceSingleRegion 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4] hfiles 2023-02-09 05:03:34,617 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4 for snapshot=testWithMapReduceSingleRegion 2023-02-09 05:03:34,643 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. completed. 2023-02-09 05:03:34,643 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:34,643 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-09 05:03:34,644 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-09 05:03:34,644 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,644 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-09 05:03:34,644 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42955,1675919012387' in zk 2023-02-09 05:03:34,646 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-09 05:03:34,646 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,646 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:34,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:34,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:34,646 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-09 05:03:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:34,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,42955,1675919012387': 2023-02-09 05:03:34,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42955,1675919012387' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-09 05:03:34,650 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-09 05:03:34,650 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:34,650 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:34,650 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-09 05:03:34,650 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 05:03:34,651 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,651 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,651 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:34,651 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,652 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 05:03:34,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:34,652 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:34,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,652 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:34,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,654 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:34,654 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-09 05:03:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 05:03:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:34,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,660 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 05:03:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 05:03:34,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:34,660 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-09 05:03:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:34,661 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,661 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,661 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:34,661 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-09 05:03:34,661 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-09 05:03:34,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 05:03:34,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 05:03:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 05:03:34,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-09 05:03:34,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-09 05:03:34,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 05:03:34,693 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-09 05:03:34,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675919014500Consolidate snapshot: testWithMapReduceSingleRegion at 1675919014660 (+160 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675919014660Writing data manifest for testWithMapReduceSingleRegion at 1675919014663 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675919014671 (+8 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675919014692 (+21 ms) 2023-02-09 05:03:34,697 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-09 05:03:34,698 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 196 msec 2023-02-09 05:03:34,806 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 05:03:34,807 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,807 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-09 05:03:34,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 05:03:34,808 INFO [Listener at localhost/38219] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-09 05:03:34,809 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,809 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,812 INFO [Listener at localhost/38219] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-09 05:03:34,818 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-09 05:03:34,858 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42955] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:34,957 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-09 05:03:34,964 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:34,965 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:34,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-09 05:03:34,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-09 05:03:34,968 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-09 05:03:34,969 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:34,969 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-09 05:03:34,969 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-09 05:03:34,969 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:34,969 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:34,972 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:34,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:34,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:34,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:34,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:34,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:03:34,975 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:34,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:34,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:34,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 05:03:34,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:34,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-09 05:03:34,980 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,981 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:03:34,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-09 05:03:34,992 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:34,992 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 05:03:35,004 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:03:35,004 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:35,004 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:03:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 05:03:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-09 05:03:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 05:03:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 05:03:35,006 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,006 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. started... 2023-02-09 05:03:35,006 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2c99d732a93eb1f83a91b3716108c276 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-09 05:03:35,006 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-09 05:03:35,007 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:03:35,007 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42223,1675919012356' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:03:35,011 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,011 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,011 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:35,042 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f1/953d61bc13644c5cb90f96157de9eea7 2023-02-09 05:03:35,078 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f2/96ce5668ad9c4b8aabfc3b51d669d76d 2023-02-09 05:03:35,084 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f1/953d61bc13644c5cb90f96157de9eea7 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/953d61bc13644c5cb90f96157de9eea7 2023-02-09 05:03:35,089 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/953d61bc13644c5cb90f96157de9eea7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:35,090 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/.tmp/f2/96ce5668ad9c4b8aabfc3b51d669d76d as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/96ce5668ad9c4b8aabfc3b51d669d76d 2023-02-09 05:03:35,094 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/96ce5668ad9c4b8aabfc3b51d669d76d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-09 05:03:35,094 INFO [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 2c99d732a93eb1f83a91b3716108c276 in 88ms, sequenceid=9, compaction requested=false 2023-02-09 05:03:35,095 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2c99d732a93eb1f83a91b3716108c276: 2023-02-09 05:03:35,095 DEBUG [rs(jenkins-hbase4.apache.org,42955,1675919012387)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,095 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 05:03:35,095 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 05:03:35,095 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,095 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-09 05:03:35,095 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42955,1675919012387' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-09 05:03:35,097 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:35,097 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:35,097 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,097 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 05:03:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:35,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42955,1675919012387' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-09 05:03:35,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74fbf2ae[Count = 0] remaining members to acquire global barrier 2023-02-09 05:03:35,099 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-09 05:03:35,099 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:03:35,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42955,1675919012387' in zk 2023-02-09 05:03:35,100 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,100 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-09 05:03:35,100 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42223,1675919012356' in zk 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:03:35,107 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-09 05:03:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:35,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42955,1675919012387' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:03:35,107 DEBUG [member: 'jenkins-hbase4.apache.org,42223,1675919012356' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-09 05:03:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42955,1675919012387': 2023-02-09 05:03:35,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42955,1675919012387' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-09 05:03:35,110 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-09 05:03:35,110 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 05:03:35,110 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 05:03:35,110 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-09 05:03:35,110 INFO [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 05:03:35,112 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:35,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 05:03:35,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 05:03:35,112 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:35,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 05:03:35,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:35,113 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,114 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 05:03:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 05:03:35,115 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-09 05:03:35,115 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,117 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,117 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 05:03:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 05:03:35,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-09 05:03:35,118 DEBUG [(jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:35,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-09 05:03:35,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-09 05:03:35,118 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-09 05:03:35,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:35,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 05:03:35,119 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-09 05:03:35,119 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 05:03:35,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 05:03:35,219 DEBUG [Listener at localhost/38219] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 05:03:35,219 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:35,219 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 05:03:35,353 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop-2856585394960858078.jar 2023-02-09 05:03:35,361 INFO [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675919014486 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:35,361 DEBUG [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e/data/default/testWithMapReduce 2023-02-09 05:03:35,362 INFO [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(239): region to add: 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:35,362 INFO [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(585): clone region=2c99d732a93eb1f83a91b3716108c276 as 2c99d732a93eb1f83a91b3716108c276 in snapshot testWithMapReduceSingleRegion 2023-02-09 05:03:35,372 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2c99d732a93eb1f83a91b3716108c276, NAME => 'testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e 2023-02-09 05:03:35,412 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:35,412 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ba6c8fac17d04c38b4f85786770f9f95 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 05:03:35,420 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9776378300054b6e8e3669aea23a2df4 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-09 05:03:35,428 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 2c99d732a93eb1f83a91b3716108c276, disabling compactions & flushes 2023-02-09 05:03:35,428 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. after waiting 0 ms 2023-02-09 05:03:35,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,429 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:35,429 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 2c99d732a93eb1f83a91b3716108c276: Waiting for close lock at 1675919015428Disabling compacts and flushes for region at 1675919015428Disabling writes for close at 1675919015429 (+1 ms)Writing region close event to WAL at 1675919015429Closed at 1675919015429 2023-02-09 05:03:35,429 INFO [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675919014486 type: FLUSH version: 2 ttl: 0 2023-02-09 05:03:35,429 DEBUG [Listener at localhost/38219] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e 2023-02-09 05:03:35,429 DEBUG [Listener at localhost/38219] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e 2023-02-09 05:03:35,432 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |-data/ 2023-02-09 05:03:35,436 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |----default/ 2023-02-09 05:03:35,437 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-09 05:03:35,437 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |----------2c99d732a93eb1f83a91b3716108c276/ 2023-02-09 05:03:35,438 DEBUG [Listener at localhost/38219] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-09 05:03:35,438 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |-------------f1/ 2023-02-09 05:03:35,438 DEBUG [Listener at localhost/38219] util.CommonFSUtils(702): |----------------testWithMapReduce=2c99d732a93eb1f83a91b3716108c276-ba6c8fac17d04c38b4f85786770f9f95 2023-02-09 05:03:35,438 DEBUG [Listener at localhost/38219] util.CommonFSUtils(699): |-------------f2/ 2023-02-09 05:03:35,439 DEBUG [Listener at localhost/38219] util.CommonFSUtils(702): |----------------testWithMapReduce=2c99d732a93eb1f83a91b3716108c276-9776378300054b6e8e3669aea23a2df4 2023-02-09 05:03:35,439 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:35,440 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:35,440 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:35,441 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,559 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop-6961807486689086076.jar 2023-02-09 05:03:36,559 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,560 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,653 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop-6568408036307795408.jar 2023-02-09 05:03:36,654 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,655 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,655 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,656 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,656 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,657 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,657 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-09 05:03:36,658 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-09 05:03:36,658 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-09 05:03:36,659 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-09 05:03:36,659 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-09 05:03:36,660 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-09 05:03:36,661 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-09 05:03:36,661 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-09 05:03:36,662 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-09 05:03:36,663 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-09 05:03:36,663 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-09 05:03:36,664 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:36,664 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:36,665 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-09 05:03:36,666 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:03:36,743 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/hadoop-2597077125799498676.jar 2023-02-09 05:03:36,744 DEBUG [Listener at localhost/38219] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-09 05:03:36,751 WARN [Listener at localhost/38219] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-09 05:03:36,766 WARN [Listener at localhost/38219] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-09 05:03:36,773 INFO [Listener at localhost/38219] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-09 05:03:36,864 WARN [Listener at localhost/38219] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/mapreduce.cluster.local.dir/1675919016822/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-09 05:03:36,864 WARN [Listener at localhost/38219] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/mapreduce.cluster.local.dir/1675919016822/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-09 05:03:36,912 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 05:03:36,912 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-09 05:03:36,916 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 05:03:36,919 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:36,920 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1 2023-02-09 05:03:36,920 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c99d732a93eb1f83a91b3716108c276 columnFamilyName f1 2023-02-09 05:03:36,927 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(539): loaded hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/testWithMapReduce=2c99d732a93eb1f83a91b3716108c276-ba6c8fac17d04c38b4f85786770f9f95 2023-02-09 05:03:36,927 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(310): Store=2c99d732a93eb1f83a91b3716108c276/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:36,927 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:36,928 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2 2023-02-09 05:03:36,929 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c99d732a93eb1f83a91b3716108c276 columnFamilyName f2 2023-02-09 05:03:36,940 DEBUG [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(539): loaded hdfs://localhost:41037/user/jenkins/test-data/0aa667ac-e2ce-9e7e-293a-a498f23a2eb2/testWithMapReduceSingleRegion/926cb3c6-f246-4f6a-95b4-72e5b8388a0e/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/testWithMapReduce=2c99d732a93eb1f83a91b3716108c276-9776378300054b6e8e3669aea23a2df4 2023-02-09 05:03:36,940 INFO [StoreOpener-2c99d732a93eb1f83a91b3716108c276-1] regionserver.HStore(310): Store=2c99d732a93eb1f83a91b3716108c276/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 05:03:36,940 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 05:03:36,941 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2c99d732a93eb1f83a91b3716108c276; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59915560, jitterRate=-0.10718858242034912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 05:03:36,941 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2c99d732a93eb1f83a91b3716108c276: Writing region info on filesystem at 1675919016916Initializing all the Stores at 1675919016917 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919016917Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675919016917Region opened successfully at 1675919016941 (+24 ms) 2023-02-09 05:03:37,020 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2c99d732a93eb1f83a91b3716108c276, disabling compactions & flushes 2023-02-09 05:03:37,021 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:37,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:37,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. after waiting 0 ms 2023-02-09 05:03:37,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:37,022 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:37,022 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2c99d732a93eb1f83a91b3716108c276: Waiting for close lock at 1675919017020Disabling compacts and flushes for region at 1675919017020Disabling writes for close at 1675919017021 (+1 ms)Writing region close event to WAL at 1675919017022 (+1 ms)Closed at 1675919017022 2023-02-09 05:03:37,909 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:37,909 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:37,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-09 05:03:37,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-09 05:03:37,914 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:37,914 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:37,915 INFO [Listener at localhost/38219] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-09 05:03:37,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-09 05:03:37,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-09 05:03:37,918 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:37,918 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:37,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919017919"}]},"ts":"1675919017919"} 2023-02-09 05:03:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:37,921 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-09 05:03:37,922 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-09 05:03:37,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, UNASSIGN}] 2023-02-09 05:03:37,924 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, UNASSIGN 2023-02-09 05:03:37,925 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2c99d732a93eb1f83a91b3716108c276, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:37,925 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675919017925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675919017925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675919017925"}]},"ts":"1675919017925"} 2023-02-09 05:03:37,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 2c99d732a93eb1f83a91b3716108c276, server=jenkins-hbase4.apache.org,42955,1675919012387}] 2023-02-09 05:03:38,020 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:38,020 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:38,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:38,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:38,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2c99d732a93eb1f83a91b3716108c276, disabling compactions & flushes 2023-02-09 05:03:38,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:38,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:38,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. after waiting 0 ms 2023-02-09 05:03:38,080 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:38,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-09 05:03:38,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276. 2023-02-09 05:03:38,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2c99d732a93eb1f83a91b3716108c276: Waiting for close lock at 1675919018079Running coprocessor pre-close hooks at 1675919018079Disabling compacts and flushes for region at 1675919018079Disabling writes for close at 1675919018080 (+1 ms)Writing region close event to WAL at 1675919018083 (+3 ms)Running coprocessor post-close hooks at 1675919018087 (+4 ms)Closed at 1675919018089 (+2 ms) 2023-02-09 05:03:38,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:38,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=2c99d732a93eb1f83a91b3716108c276, regionState=CLOSED 2023-02-09 05:03:38,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675919018091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675919018091"}]},"ts":"1675919018091"} 2023-02-09 05:03:38,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-09 05:03:38,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 2c99d732a93eb1f83a91b3716108c276, server=jenkins-hbase4.apache.org,42955,1675919012387 in 165 msec 2023-02-09 05:03:38,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 05:03:38,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2c99d732a93eb1f83a91b3716108c276, UNASSIGN in 175 msec 2023-02-09 05:03:38,101 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675919018101"}]},"ts":"1675919018101"} 2023-02-09 05:03:38,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-09 05:03:38,109 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-09 05:03:38,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 197 msec 2023-02-09 05:03:38,222 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:38,222 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:38,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-09 05:03:38,225 INFO [Listener at localhost/38219] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-09 05:03:38,225 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:38,225 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:38,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-09 05:03:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,229 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,229 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:38,229 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:38,229 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:38,232 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:38,235 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1, FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2, FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/recovered.edits] 2023-02-09 05:03:38,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/953d61bc13644c5cb90f96157de9eea7 to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/archive/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/953d61bc13644c5cb90f96157de9eea7 2023-02-09 05:03:38,241 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95 to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/archive/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f1/ba6c8fac17d04c38b4f85786770f9f95 2023-02-09 05:03:38,244 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/96ce5668ad9c4b8aabfc3b51d669d76d to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/archive/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/96ce5668ad9c4b8aabfc3b51d669d76d 2023-02-09 05:03:38,245 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4 to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/archive/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/f2/9776378300054b6e8e3669aea23a2df4 2023-02-09 05:03:38,249 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/recovered.edits/12.seqid to hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/archive/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276/recovered.edits/12.seqid 2023-02-09 05:03:38,249 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/.tmp/data/default/testWithMapReduce/2c99d732a93eb1f83a91b3716108c276 2023-02-09 05:03:38,249 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-09 05:03:38,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,253 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-09 05:03:38,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-09 05:03:38,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,260 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-09 05:03:38,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675919018260"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:38,261 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 05:03:38,262 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2c99d732a93eb1f83a91b3716108c276, NAME => 'testWithMapReduce,,1675919013524.2c99d732a93eb1f83a91b3716108c276.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 05:03:38,262 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-09 05:03:38,262 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675919018262"}]},"ts":"9223372036854775807"} 2023-02-09 05:03:38,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-09 05:03:38,265 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-09 05:03:38,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 39 msec 2023-02-09 05:03:38,330 INFO [Listener at localhost/38219] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-09 05:03:38,330 INFO [Listener at localhost/38219] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-09 05:03:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36533] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-09 05:03:38,332 INFO [Listener at localhost/38219] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-09 05:03:38,332 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 05:03:38,332 INFO [Listener at localhost/38219] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 05:03:38,332 DEBUG [Listener at localhost/38219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ec593d2 to 127.0.0.1:59719 2023-02-09 05:03:38,332 DEBUG [Listener at localhost/38219] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,333 DEBUG [Listener at localhost/38219] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 05:03:38,333 DEBUG [Listener at localhost/38219] util.JVMClusterUtil(257): Found active master hash=41956533, stopped=false 2023-02-09 05:03:38,333 INFO [Listener at localhost/38219] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:38,339 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:38,339 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:38,339 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 05:03:38,339 INFO [Listener at localhost/38219] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 05:03:38,339 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:38,341 DEBUG [Listener at localhost/38219] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14471f03 to 127.0.0.1:59719 2023-02-09 05:03:38,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:38,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:38,342 DEBUG [Listener at localhost/38219] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,342 INFO [Listener at localhost/38219] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42223,1675919012356' ***** 2023-02-09 05:03:38,342 INFO [Listener at localhost/38219] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:38,342 INFO [Listener at localhost/38219] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42955,1675919012387' ***** 2023-02-09 05:03:38,342 INFO [Listener at localhost/38219] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 05:03:38,342 INFO [RS:0;jenkins-hbase4:42223] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:38,342 INFO [RS:0;jenkins-hbase4:42223] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:38,343 INFO [RS:0;jenkins-hbase4:42223] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:38,343 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:38,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 05:03:38,343 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(3304): Received CLOSE for ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:38,343 INFO [RS:1;jenkins-hbase4:42955] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 05:03:38,400 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 05:03:38,400 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:38,400 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:38,402 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:38,403 INFO [RS:1;jenkins-hbase4:42955] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 05:03:38,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ef80ab76fe4b9cba1b3aeb72d811d899, disabling compactions & flushes 2023-02-09 05:03:38,403 DEBUG [RS:0;jenkins-hbase4:42223] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fd9fadf to 127.0.0.1:59719 2023-02-09 05:03:38,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:38,403 INFO [RS:1;jenkins-hbase4:42955] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 05:03:38,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:38,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. after waiting 0 ms 2023-02-09 05:03:38,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:38,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ef80ab76fe4b9cba1b3aeb72d811d899 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-09 05:03:38,404 DEBUG [RS:0;jenkins-hbase4:42223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,404 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:38,404 DEBUG [RS:1;jenkins-hbase4:42955] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18dfc4dc to 127.0.0.1:59719 2023-02-09 05:03:38,404 INFO [RS:0;jenkins-hbase4:42223] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:38,404 INFO [RS:0;jenkins-hbase4:42223] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:38,404 INFO [RS:0;jenkins-hbase4:42223] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:38,404 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 05:03:38,404 DEBUG [RS:1;jenkins-hbase4:42955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,405 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42955,1675919012387; all regions closed. 2023-02-09 05:03:38,408 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-09 05:03:38,408 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1479): Online Regions={ef80ab76fe4b9cba1b3aeb72d811d899=hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899., 1588230740=hbase:meta,,1.1588230740} 2023-02-09 05:03:38,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 05:03:38,408 DEBUG [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1505): Waiting on 1588230740, ef80ab76fe4b9cba1b3aeb72d811d899 2023-02-09 05:03:38,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 05:03:38,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 05:03:38,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 05:03:38,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 05:03:38,408 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-09 05:03:38,420 DEBUG [RS:1;jenkins-hbase4:42955] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs 2023-02-09 05:03:38,420 INFO [RS:1;jenkins-hbase4:42955] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42955%2C1675919012387:(num 1675919013712) 2023-02-09 05:03:38,420 DEBUG [RS:1;jenkins-hbase4:42955] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,421 INFO [RS:1;jenkins-hbase4:42955] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:38,424 INFO [RS:1;jenkins-hbase4:42955] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:38,428 INFO [RS:1;jenkins-hbase4:42955] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 05:03:38,428 INFO [RS:1;jenkins-hbase4:42955] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 05:03:38,428 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:38,428 INFO [RS:1;jenkins-hbase4:42955] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 05:03:38,430 INFO [RS:1;jenkins-hbase4:42955] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42955 2023-02-09 05:03:38,431 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:38,431 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42955,1675919012387 2023-02-09 05:03:38,431 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:38,431 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:38,431 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:38,432 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42955,1675919012387] 2023-02-09 05:03:38,432 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42955,1675919012387; numProcessing=1 2023-02-09 05:03:38,434 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42955,1675919012387 already deleted, retry=false 2023-02-09 05:03:38,434 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42955,1675919012387 expired; onlineServers=1 2023-02-09 05:03:38,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/.tmp/info/7b6a830d0e834fdea4693bc401cf6850 2023-02-09 05:03:38,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/.tmp/info/7b6a830d0e834fdea4693bc401cf6850 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/info/7b6a830d0e834fdea4693bc401cf6850 2023-02-09 05:03:38,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/info/f59c5070bec2454ebef273ef10873eb8 2023-02-09 05:03:38,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/info/7b6a830d0e834fdea4693bc401cf6850, entries=2, sequenceid=6, filesize=4.8 K 2023-02-09 05:03:38,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f59c5070bec2454ebef273ef10873eb8 2023-02-09 05:03:38,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ef80ab76fe4b9cba1b3aeb72d811d899 in 46ms, sequenceid=6, compaction requested=false 2023-02-09 05:03:38,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/namespace/ef80ab76fe4b9cba1b3aeb72d811d899/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-09 05:03:38,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:38,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ef80ab76fe4b9cba1b3aeb72d811d899: Waiting for close lock at 1675919018403Running coprocessor pre-close hooks at 1675919018403Disabling compacts and flushes for region at 1675919018403Disabling writes for close at 1675919018404 (+1 ms)Obtaining lock to block concurrent updates at 1675919018404Preparing flush snapshotting stores in ef80ab76fe4b9cba1b3aeb72d811d899 at 1675919018404Finished memstore snapshotting hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675919018404Flushing stores of hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. at 1675919018408 (+4 ms)Flushing ef80ab76fe4b9cba1b3aeb72d811d899/info: creating writer at 1675919018408Flushing ef80ab76fe4b9cba1b3aeb72d811d899/info: appending metadata at 1675919018413 (+5 ms)Flushing ef80ab76fe4b9cba1b3aeb72d811d899/info: closing flushed file at 1675919018413Flushing ef80ab76fe4b9cba1b3aeb72d811d899/info: reopening flushed file at 1675919018441 (+28 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ef80ab76fe4b9cba1b3aeb72d811d899 in 46ms, sequenceid=6, compaction requested=false at 1675919018450 (+9 ms)Writing region close event to WAL at 1675919018450Running coprocessor post-close hooks at 1675919018457 (+7 ms)Closed at 1675919018459 (+2 ms) 2023-02-09 05:03:38,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675919012998.ef80ab76fe4b9cba1b3aeb72d811d899. 2023-02-09 05:03:38,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/rep_barrier/a888f7228ee14672a12e02f1d857ea39 2023-02-09 05:03:38,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a888f7228ee14672a12e02f1d857ea39 2023-02-09 05:03:38,478 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/table/065db8c2ad664a0ca7fb6914da9822a5 2023-02-09 05:03:38,482 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 065db8c2ad664a0ca7fb6914da9822a5 2023-02-09 05:03:38,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/info/f59c5070bec2454ebef273ef10873eb8 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/info/f59c5070bec2454ebef273ef10873eb8 2023-02-09 05:03:38,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f59c5070bec2454ebef273ef10873eb8 2023-02-09 05:03:38,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/info/f59c5070bec2454ebef273ef10873eb8, entries=12, sequenceid=21, filesize=6.2 K 2023-02-09 05:03:38,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/rep_barrier/a888f7228ee14672a12e02f1d857ea39 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/rep_barrier/a888f7228ee14672a12e02f1d857ea39 2023-02-09 05:03:38,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a888f7228ee14672a12e02f1d857ea39 2023-02-09 05:03:38,502 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/rep_barrier/a888f7228ee14672a12e02f1d857ea39, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 05:03:38,503 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/.tmp/table/065db8c2ad664a0ca7fb6914da9822a5 as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/table/065db8c2ad664a0ca7fb6914da9822a5 2023-02-09 05:03:38,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 065db8c2ad664a0ca7fb6914da9822a5 2023-02-09 05:03:38,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/table/065db8c2ad664a0ca7fb6914da9822a5, entries=4, sequenceid=21, filesize=5.0 K 2023-02-09 05:03:38,508 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=21, compaction requested=false 2023-02-09 05:03:38,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-09 05:03:38,521 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 05:03:38,522 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:38,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675919018408Running coprocessor pre-close hooks at 1675919018408Disabling compacts and flushes for region at 1675919018408Disabling writes for close at 1675919018408Obtaining lock to block concurrent updates at 1675919018408Preparing flush snapshotting stores in 1588230740 at 1675919018408Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675919018408Flushing stores of hbase:meta,,1.1588230740 at 1675919018412 (+4 ms)Flushing 1588230740/info: creating writer at 1675919018412Flushing 1588230740/info: appending metadata at 1675919018420 (+8 ms)Flushing 1588230740/info: closing flushed file at 1675919018420Flushing 1588230740/rep_barrier: creating writer at 1675919018450 (+30 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675919018452 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675919018452Flushing 1588230740/table: creating writer at 1675919018465 (+13 ms)Flushing 1588230740/table: appending metadata at 1675919018467 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675919018467Flushing 1588230740/info: reopening flushed file at 1675919018483 (+16 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675919018488 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675919018504 (+16 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=21, compaction requested=false at 1675919018508 (+4 ms)Writing region close event to WAL at 1675919018516 (+8 ms)Running coprocessor post-close hooks at 1675919018521 (+5 ms)Closed at 1675919018522 (+1 ms) 2023-02-09 05:03:38,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 05:03:38,535 INFO [RS:1;jenkins-hbase4:42955] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42955,1675919012387; zookeeper connection closed. 2023-02-09 05:03:38,535 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:38,535 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7498baf5 rejected from java.util.concurrent.ThreadPoolExecutor@70a720be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:38,536 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42955-0x10037769b730002, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:38,536 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35249c8f rejected from java.util.concurrent.ThreadPoolExecutor@70a720be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:38,536 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1902fc8b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1902fc8b 2023-02-09 05:03:38,608 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42223,1675919012356; all regions closed. 2023-02-09 05:03:38,613 DEBUG [RS:0;jenkins-hbase4:42223] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs 2023-02-09 05:03:38,613 INFO [RS:0;jenkins-hbase4:42223] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42223%2C1675919012356.meta:.meta(num 1675919012952) 2023-02-09 05:03:38,616 DEBUG [RS:0;jenkins-hbase4:42223] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/oldWALs 2023-02-09 05:03:38,617 INFO [RS:0;jenkins-hbase4:42223] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42223%2C1675919012356:(num 1675919013338) 2023-02-09 05:03:38,617 DEBUG [RS:0;jenkins-hbase4:42223] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,617 INFO [RS:0;jenkins-hbase4:42223] regionserver.LeaseManager(133): Closed leases 2023-02-09 05:03:38,617 INFO [RS:0;jenkins-hbase4:42223] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 05:03:38,617 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:38,622 INFO [RS:0;jenkins-hbase4:42223] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42223 2023-02-09 05:03:38,623 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42223,1675919012356 2023-02-09 05:03:38,623 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 05:03:38,625 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42223,1675919012356] 2023-02-09 05:03:38,625 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42223,1675919012356; numProcessing=2 2023-02-09 05:03:38,627 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42223,1675919012356 already deleted, retry=false 2023-02-09 05:03:38,627 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42223,1675919012356 expired; onlineServers=0 2023-02-09 05:03:38,627 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36533,1675919012294' ***** 2023-02-09 05:03:38,627 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 05:03:38,628 DEBUG [M:0;jenkins-hbase4:36533] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bfb03d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-09 05:03:38,628 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36533,1675919012294 2023-02-09 05:03:38,628 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36533,1675919012294; all regions closed. 2023-02-09 05:03:38,628 DEBUG [M:0;jenkins-hbase4:36533] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 05:03:38,629 DEBUG [M:0;jenkins-hbase4:36533] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 05:03:38,629 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 05:03:38,629 DEBUG [M:0;jenkins-hbase4:36533] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 05:03:38,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919012572] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675919012572,5,FailOnTimeoutGroup] 2023-02-09 05:03:38,629 INFO [M:0;jenkins-hbase4:36533] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 05:03:38,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919012577] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675919012577,5,FailOnTimeoutGroup] 2023-02-09 05:03:38,630 INFO [M:0;jenkins-hbase4:36533] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 05:03:38,631 INFO [M:0;jenkins-hbase4:36533] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-09 05:03:38,631 DEBUG [M:0;jenkins-hbase4:36533] master.HMaster(1502): Stopping service threads 2023-02-09 05:03:38,631 INFO [M:0;jenkins-hbase4:36533] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 05:03:38,631 ERROR [M:0;jenkins-hbase4:36533] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-09 05:03:38,631 INFO [M:0;jenkins-hbase4:36533] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 05:03:38,631 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 05:03:38,632 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 05:03:38,632 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 05:03:38,632 DEBUG [M:0;jenkins-hbase4:36533] zookeeper.ZKUtil(398): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 05:03:38,632 WARN [M:0;jenkins-hbase4:36533] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 05:03:38,632 INFO [M:0;jenkins-hbase4:36533] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 05:03:38,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 05:03:38,633 INFO [M:0;jenkins-hbase4:36533] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 05:03:38,633 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 05:03:38,634 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:38,634 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:38,634 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 05:03:38,634 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:38,634 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-09 05:03:38,649 INFO [M:0;jenkins-hbase4:36533] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9dbc723b19e74e9eb9ca193ec03113fd 2023-02-09 05:03:38,653 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9dbc723b19e74e9eb9ca193ec03113fd as hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9dbc723b19e74e9eb9ca193ec03113fd 2023-02-09 05:03:38,657 INFO [M:0;jenkins-hbase4:36533] regionserver.HStore(1080): Added hdfs://localhost:41037/user/jenkins/test-data/c823b731-41c8-4d18-bf51-65509de418b1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9dbc723b19e74e9eb9ca193ec03113fd, entries=17, sequenceid=132, filesize=8.6 K 2023-02-09 05:03:38,657 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false 2023-02-09 05:03:38,658 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 05:03:38,658 DEBUG [M:0;jenkins-hbase4:36533] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675919018633Disabling compacts and flushes for region at 1675919018633Disabling writes for close at 1675919018634 (+1 ms)Obtaining lock to block concurrent updates at 1675919018634Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675919018634Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56025, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675919018634Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675919018635 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675919018635Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675919018637 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675919018637Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675919018654 (+17 ms)Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false at 1675919018658 (+4 ms)Writing region close event to WAL at 1675919018658Closed at 1675919018658 2023-02-09 05:03:38,661 INFO [M:0;jenkins-hbase4:36533] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 05:03:38,661 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 05:03:38,661 INFO [M:0;jenkins-hbase4:36533] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36533 2023-02-09 05:03:38,663 DEBUG [M:0;jenkins-hbase4:36533] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36533,1675919012294 already deleted, retry=false 2023-02-09 05:03:38,936 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:38,936 INFO [M:0;jenkins-hbase4:36533] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36533,1675919012294; zookeeper connection closed. 2023-02-09 05:03:38,936 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c7e504f rejected from java.util.concurrent.ThreadPoolExecutor@3841c318[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:38,937 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): master:36533-0x10037769b730000, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:38,937 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@246575c rejected from java.util.concurrent.ThreadPoolExecutor@3841c318[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:39,036 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:39,036 INFO [RS:0;jenkins-hbase4:42223] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42223,1675919012356; zookeeper connection closed. 2023-02-09 05:03:39,036 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f2f6ba1 rejected from java.util.concurrent.ThreadPoolExecutor@7b10e09c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:39,036 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5df43517] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5df43517 2023-02-09 05:03:39,036 DEBUG [Listener at localhost/38219-EventThread] zookeeper.ZKWatcher(600): regionserver:42223-0x10037769b730001, quorum=127.0.0.1:59719, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 05:03:39,037 ERROR [Listener at localhost/38219-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b103a5f rejected from java.util.concurrent.ThreadPoolExecutor@7b10e09c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 05:03:39,037 INFO [Listener at localhost/38219] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-09 05:03:39,037 WARN [Listener at localhost/38219] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:39,041 INFO [Listener at localhost/38219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:39,145 WARN [BP-396059932-172.31.14.131-1675919011695 heartbeating to localhost/127.0.0.1:41037] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:39,145 WARN [BP-396059932-172.31.14.131-1675919011695 heartbeating to localhost/127.0.0.1:41037] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-396059932-172.31.14.131-1675919011695 (Datanode Uuid 7d05aa60-3879-4e64-bfcf-581aa0fd357e) service to localhost/127.0.0.1:41037 2023-02-09 05:03:39,146 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/dfs/data/data3/current/BP-396059932-172.31.14.131-1675919011695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:39,146 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/dfs/data/data4/current/BP-396059932-172.31.14.131-1675919011695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:39,147 WARN [Listener at localhost/38219] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 05:03:39,152 INFO [Listener at localhost/38219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:39,253 WARN [BP-396059932-172.31.14.131-1675919011695 heartbeating to localhost/127.0.0.1:41037] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 05:03:39,253 WARN [BP-396059932-172.31.14.131-1675919011695 heartbeating to localhost/127.0.0.1:41037] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-396059932-172.31.14.131-1675919011695 (Datanode Uuid 7fd80a74-0206-4568-857b-6c2507457245) service to localhost/127.0.0.1:41037 2023-02-09 05:03:39,253 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/dfs/data/data1/current/BP-396059932-172.31.14.131-1675919011695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:39,254 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8fdeca27-d5a9-ccbe-9d18-0c36c458d6ae/cluster_9a714477-93f7-aa17-ed35-b3f88876e7d4/dfs/data/data2/current/BP-396059932-172.31.14.131-1675919011695] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 05:03:39,265 INFO [Listener at localhost/38219] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 05:03:39,378 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-09 05:03:39,378 INFO [Listener at localhost/38219] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 05:03:39,412 INFO [Listener at localhost/38219] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-09 05:03:39,428 INFO [Listener at localhost/38219] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 276) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41037 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:41037 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/38219 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41037 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41037 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:41037 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41037 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36533,1675919012294)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1920169240) connection to localhost/127.0.0.1:41037 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=596 (was 569) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=293 (was 240) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=2735 (was 3633)